00000001:02000400:1.0F:1787832524.875835:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_hostid 00000001:02000400:1.0:1787832543.795106:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787832545.364930:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 450 MB/s 00000001:01000000:3.0:1787832545.616785:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1345 MB/s 00000001:01000000:2.0F:1787832545.867689:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4903 MB/s 00000020:02000000:0.0F:1787832546.685132:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_60_g13a1c7b 00000400:02000000:1.0:1787832547.442486:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.134@tcp [8/256/0/180] 00008000:02000000:3.0:1787832551.494506:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787832615.632308:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787832629.756503:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787832629.756512:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787832629.756683:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000059e65187 00000080:02000400:2.0:1787832629.756698:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787832629.764686:0:5825:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787832629.764814:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787832629.764873:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ea2551ec) 00000020:00000080:2.0:1787832629.764915:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787832629.810386:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787832629.811001:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787832629.907458:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787832629.907522:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787832629.907545:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787832629.907600:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787832629.907629:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787832629.910581:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787832629.910596:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787832629.910612:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b68f1 00000020:01000004:2.0:1787832629.910622:0:5825:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787832629.910628:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787832629.910634:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000059e65187 from MGS 00000020:01000004:2.0:1787832629.910640:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787832629.910653:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cd62dfdb) 00000020:00000080:2.0:1787832629.910667:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787832629.910841:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000059e65187 from MGS, refs=2 00080000:01000000:2.0:1787832629.910849:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787832629.910855:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b68ff 00000100:00100000:2.0:1787832629.911002:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787832629.911205:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787832629.911212:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787832629.918510:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787832629.918530:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787832629.933535:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832629.935248:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787832629.935262:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787832629.938586:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787832629.938613:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787832629.941279:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787832629.941295:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787832629.948524:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832629.948533:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832629.948535:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832629.950497:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832629.950503:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832629.950506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832629.951951:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787832629.956731:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787832630.201932:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1643 MB/s 00000001:01000000:2.0:1787832630.451946:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1875 MB/s 00000001:01000000:2.0:1787832630.702637:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 395 MB/s 00000001:01000000:2.0:1787832630.953501:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 354 MB/s 00080000:10000000:2.0:1787832630.986193:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787832630.992452:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787832631.044942:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787832631.044974:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787832631.044978:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787832631.057002:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787832631.057138:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787832631.057225:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787832631.057571:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787832631.057603:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787832631.058117:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787832631.058317:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787832631.058325:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787832631.080217:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787832631.080239:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787832631.080935:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787832631.080942:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787832631.081598:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787832631.081629:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:0.0:1787832631.081631:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787832631.081726:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:0.0:1787832631.081754:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (000000000d1ad17c) 00000020:00000080:0.0:1787832631.081777:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787832631.081944:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000045665e5@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00000100:00080000:2.0:1787832631.082840:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787832631.083069:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:0.0:1787832631.083079:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787832631.084931:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787832631.084991:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid 204f2893-acc1-48f1-8f52-36a94d59ea17) 00000020:00000080:2.0:1787832631.085020:0:5825:0:(genops.c:1385:class_connect()) connect: client 204f2893-acc1-48f1-8f52-36a94d59ea17, cookie 0x72bd9178b14b690d 00000100:00080000:2.0:1787832631.085036:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787832631.085042:0:5825:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import 00000000045665e5 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832631.085097:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d8baf8c5 x1874678300803200/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787832631.085121:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS 00000020:01000004:2.0:1787832631.085142:0:5825:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787832631.085149:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787832631.085165:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000743496a2) 00000020:00000080:2.0:1787832631.085177:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787832631.097437:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.097930:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787832631.097937:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787832631.099843:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8baf8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300803200:0@lo:250: 00000100:00100000:2.0:1787832631.099990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832631.100116:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803200 00000100:00100000:2.0:1787832631.100125:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803200 00000100:00100000:2.0:1787832631.100160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832631.100171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075f79573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874678300803200:12345-0@lo:250: 00010000:00080000:2.0:1787832631.100197:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 204f2893-acc1-48f1-8f52-36a94d59ea17@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1787832631.100244:0:5837:0:(genops.c:1385:class_connect()) connect: client 204f2893-acc1-48f1-8f52-36a94d59ea17, cookie 0x72bd9178b14b691b 00000100:00080000:2.0:1787832631.100887:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000b58a0d64 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832631.101038:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075f79573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+5:3304:x1874678300803200:12345-0@lo:250: Request processed in 866us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832631.101049:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832631.101108:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787832631.101116:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:2.0:1787832631.101122:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787832631.101127:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787832631.101130:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000045665e5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787832631.101132:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787832631.101139:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787832631.101143:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8baf8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300803200:0@lo:250: 00000100:00100000:2.0:1787832631.120849:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787832631.121032:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787832631.121557:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787832631.121563:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787832631.122282:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.123048:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787832631.123055:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787832631.127501:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787832631.127517:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787832631.163689:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.179988:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787832631.180002:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787832631.182136:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787832631.182151:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787832631.184663:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.185027:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787832631.185035:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787832631.187576:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787832631.187594:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787832631.191056:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.191242:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787832631.191249:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787832631.194070:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787832631.194083:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787832631.195271:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832631.195520:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787832631.195534:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787832631.197543:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787832631.197555:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787832631.271639:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787832631.274301:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787832631.274310:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787832631.280378:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787832631.280393:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787832631.281534:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787832631.281866:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787832631.297903:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787832631.297935:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787832631.297942:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787832631.298116:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787832631.298156:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787832631.298161:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787832631.298163:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787832631.298164:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832631.298165:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832631.298167:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832631.298168:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832631.298169:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787832631.298171:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787832631.298172:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787832631.298174:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787832631.298175:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832631.298177:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832631.298179:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787832631.298181:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787832631.298183:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787832631.298184:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832631.298185:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832631.298190:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832631.298191:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832631.298192:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787832631.298193:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787832631.298194:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787832631.298195:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787832631.298196:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832631.298197:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832631.298223:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787832631.298240:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8baf8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803328:0@lo:253: 00000100:00100000:2.0:1787832631.298322:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832631.298380:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b41b6b6 going to sleep for 11 seconds 00000100:00100000:3.0:1787832631.300365:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803328 00000100:00100000:3.0:1787832631.300383:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803328 00000100:00100000:3.0:1787832631.300497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832631.300509:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090219de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+5:5825:x1874678300803328:12345-0@lo:253: 20000000:01000000:3.0:1787832631.300578:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787832631.300582:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787832631.304015:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787832631.304321:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787832631.304644:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832631.306624:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787832631.313233:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787832631.313241:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787832631.313248:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787832631.313251:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787832631.313265:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787832631.314246:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832631.314521:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787832631.314533:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787832631.314593:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787832631.314642:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787832631.314687:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787832631.315693:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787832631.315889:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787832631.315974:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787832631.315983:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787832631.316187:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787832631.316195:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787832631.316220:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787832631.316262:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787832631.316307:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787832631.316318:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787832631.316332:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832631.316817:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787832631.316828:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787832631.316874:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787832631.316911:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787832631.316959:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787832631.316970:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787832631.317202:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787832631.317211:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787832631.317249:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787832631.317280:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787832631.317307:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787832631.317317:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787832631.317461:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787832631.317470:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787832631.317499:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787832631.323350:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787832631.323995:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787832631.324037:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787832631.324045:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787832631.326802:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787832631.327806:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787832631.327837:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.134@tcp for mdt 20000000:01000000:2.0:1787832631.327839:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:2.0:1787832631.327895:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787832631.327904:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787832631.327935:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787832631.327943:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:2.0:1787832631.328017:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787832631.328028:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787832631.328062:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787832631.328098:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787832631.328178:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787832631.328182:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787832631.328187:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787832631.328192:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787832631.329823:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1787832631.330028:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787832631.364361:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787832631.364439:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787832631.364513:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787832631.364534:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787832631.364536:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787832631.364539:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787832631.364565:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787832631.364568:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787832631.364612:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787832631.364615:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787832631.367024:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787832631.369213:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787832631.369267:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787832631.369346:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1787832631.369363:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787832631.372153:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787832631.372625:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787832631.373017:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787832631.373152:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787832631.373190:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787832631.373221:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787832631.373223:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787832631.373232:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787832631.373253:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373272:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373282:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373288:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373294:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373300:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373307:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c6db9de already unused, calling callback (00000000860ff245) 00010000:00010000:0.0:1787832631.373310:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373318:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373330:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373338:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.373354:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c6db9de/0x72bd9178b14b6922 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787832631.373371:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787832631.779879:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090219de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+5:5825:x1874678300803328:12345-0@lo:253: Request processed in 479363us (481549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832631.779913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832631.780554:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8baf8c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803328:0@lo:253: 10000000:01000000:0.0:1787832631.780571:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787832631.780574:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787832631.780576:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787832631.780577:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832631.780578:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787832631.780579:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832631.780581:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832631.780582:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787832631.780583:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787832631.780584:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787832631.780585:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832631.780587:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787832631.780606:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000059e65187 from lustre-MDT0000 10000000:01000000:0.0:1787832631.780629:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787832631.780631:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787832631.780636:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c3543794d28 10000000:01000000:0.0:1787832631.780639:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787832631.780647:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3543794d28 from 1 10000000:01000000:0.0:1787832631.780650:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787832631.780686:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.780696:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832631.780742:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832631.780788:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000203582d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803456:0@lo:101: 00000100:00100000:0.0:1787832631.780834:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832631.780905:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb3befd7 going to sleep for 11 seconds 00000100:00100000:2.0:1787832631.781037:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803456 00000100:00100000:2.0:1787832631.781054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803456 00000100:00100000:2.0:1787832631.781105:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787832631.781113:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b20d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:5825:x1874678300803456:12345-0@lo:101: 00010000:00010000:2.0:1787832631.781126:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832631.781141:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052408150/0x72bd9178b14b6930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6929 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.781167:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052408150/0x72bd9178b14b6930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.781177:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052408150/0x72bd9178b14b6930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.781184:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052408150, rc 0) 00000100:00100000:2.0:1787832631.781222:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b20d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5825:x1874678300803456:12345-0@lo:101: Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832631.781228:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787832631.781686:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000203582d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803456:0@lo:101: 00010000:00010000:1.0:1787832631.781732:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832631.781742:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832631.781810:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010146642 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803584:0@lo:501: 00000100:00100000:1.0:1787832631.781861:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832631.782042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803584 00000100:00100000:2.0:1787832631.782055:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803584 00000100:00100000:2.0:1787832631.782091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832631.782105:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ca0ca42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5825:x1874678300803584:12345-0@lo:501: 00000100:00100000:2.0:1787832631.782331:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ca0ca42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5825:x1874678300803584:12345-0@lo:501: Request processed in 227us (470us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787832631.782338:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832631.782607:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c42d3401 going to sleep for 11 seconds 00000100:00100000:2.0:1787832631.782626:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010146642 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803584:0@lo:501: 10000000:01000000:2.0:1787832631.782656:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787832631.782766:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.782776:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000002c6db9de/0x72bd9178b14b6929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832631.782786:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3543878800 10000000:01000000:2.0:1787832631.782791:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787832631.782796:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c3543878800 10000000:01000000:2.0:1787832631.782798:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787832631.782801:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c3543878800 from 1 10000000:01000000:2.0:1787832631.782804:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787832631.782835:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.782844:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.782860:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832631.782874:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e53cff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803712:0@lo:101: 00000100:00100000:2.0:1787832631.783270:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832631.783305:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b95e2750 going to sleep for 11 seconds 00000100:00100000:1.0:1787832631.783365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803712 00000100:00100000:1.0:1787832631.783372:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803712 00000100:00100000:1.0:1787832631.783426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832631.783433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000249b0d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5825:x1874678300803712:12345-0@lo:101: 00010000:00010000:1.0:1787832631.783445:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832631.783459:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013e772f5/0x72bd9178b14b693e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6937 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832631.783477:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013e772f5/0x72bd9178b14b693e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6937 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832631.783486:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013e772f5/0x72bd9178b14b693e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6937 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832631.783495:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013e772f5, rc 0) 00000100:00100000:1.0:1787832631.783537:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000249b0d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+7:5825:x1874678300803712:12345-0@lo:101: Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832631.783544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832631.783637:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e53cff8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803712:0@lo:101: 00010000:00010000:3.0:1787832631.783651:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832631.783658:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832631.783672:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787832631.788469:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832631.788490:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000464c4b33/0x72bd9178b14b6937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832631.788500:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787832631.788510:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787832631.788519:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c3543878800 10000000:01000000:3.0:1787832631.788521:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787832631.788525:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787832631.788527:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787832631.788571:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832631.788579:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832631.788589:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832631.788615:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803840:0@lo:101: 00000100:00100000:3.0:1787832631.788685:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832631.788783:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d72a974a going to sleep for 11 seconds 00000100:00100000:2.0:1787832631.789040:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803840 00000100:00100000:2.0:1787832631.789059:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803840 00000100:00100000:2.0:1787832631.789116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787832631.789125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da9d011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+7:5825:x1874678300803840:12345-0@lo:101: 00010000:00010000:2.0:1787832631.789140:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832631.789152:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c45b203/0x72bd9178b14b694c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6945 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.789177:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c45b203/0x72bd9178b14b694c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.789186:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c45b203/0x72bd9178b14b694c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832631.789194:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c45b203, rc 0) 00000100:00100000:2.0:1787832631.789244:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da9d011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+8:5825:x1874678300803840:12345-0@lo:101: Request processed in 121us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832631.789251:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832631.789611:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803840:0@lo:101: 00010000:00010000:3.0:1787832631.789626:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832631.789635:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832631.789741:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803968:0@lo:501: 00000100:00100000:3.0:1787832631.789887:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832631.790136:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d72a974a going to sleep for 11 seconds 00000100:00100000:2.0:1787832631.790638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300803968 00000100:00100000:2.0:1787832631.790644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300803968 00000100:00100000:2.0:1787832631.790688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787832631.790695:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa929cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+8:5825:x1874678300803968:12345-0@lo:501: 00000100:00100000:2.0:1787832631.791058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa929cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5825:x1874678300803968:12345-0@lo:501: Request processed in 363us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832631.791067:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787832631.794025:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300803968:0@lo:501: 00000100:00100000:3.0:1787832631.794112:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804096:0@lo:503: 00000100:00100000:3.0:1787832631.794207:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832631.794266:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d72a974a going to sleep for 11 seconds 00000100:00100000:2.0:1787832631.795689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804096 00000100:00100000:2.0:1787832631.795719:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804096 00000100:00100000:2.0:1787832631.795949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787832631.795957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007230d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5825:x1874678300804096:12345-0@lo:503: 00000100:00100000:2.0:1787832631.796388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007230d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5825:x1874678300804096:12345-0@lo:503: Request processed in 430us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832631.796397:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787832631.796662:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804096:0@lo:503: 00000100:00100000:3.0:1787832631.797345:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5868:1874678300804224:0@lo:502: 00000100:00100000:3.0:1787832631.797401:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832631.797493:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5c2141e going to sleep for 11 seconds 00000100:00100000:1.0:1787832631.801864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804224 00000100:00100000:1.0:1787832631.801880:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804224 00000100:00100000:1.0:1787832631.802078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787832631.802088:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89096e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5868:x1874678300804224:12345-0@lo:502: 00000100:00100000:1.0:1787832631.802402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89096e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5868:x1874678300804224:12345-0@lo:502: Request processed in 315us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832631.802411:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787832631.802506:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5868:1874678300804224:0@lo:502: 00000020:01000000:3.0:1787832631.802543:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832631.802553:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832631.802556:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787832631.802561:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787832631.802563:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787832631.802585:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009ce8514e) 00000020:00000080:3.0:1787832631.802602:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787832631.802609:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787832631.802697:0:5868:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787832631.802723:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b695a 00000020:00000080:3.0:1787832631.802986:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787832631.802991:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832631.802994:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832631.803001:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787832631.803005:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832631.803009:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832631.803010:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787832631.803013:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787832631.803019:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000032d8a940) 00000020:00000080:3.0:1787832631.803029:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787832631.803033:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787832631.803034:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787832631.803037:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787832631.803042:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787832631.803087:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000059e65187 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787832631.803098:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000065e6ace2) 00000020:00000080:3.0:1787832631.803106:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787832631.803157:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787832631.803162:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b696f 00000020:00000080:3.0:1787832631.803243:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787832631.803249:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787832631.803254:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bd9178b14b6976 00080000:01000000:3.0:1787832631.803258:0:5868:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787832631.803261:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b697d 00080000:10000000:3.0:1787832631.803628:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787832631.803910:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787832631.817027:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787832631.974677:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787832631.975533:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787832631.979438:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787832631.980319:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1787832632.020146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787832632.071435:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000066a8d8a5) 00000020:00000080:3.0:1787832632.071460:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787832632.071553:0:5868:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787832632.071560:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b698b 00000020:00000080:2.0:1787832632.082929:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787832632.084277:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787832632.173892:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832632.227111:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832632.341428:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832632.470400:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787832632.568207:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787832632.649502:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bd9178b14b6992 00000020:00000080:1.0:1787832632.650039:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787832632.650049:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832632.650055:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832632.650057:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787832632.650059:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787832632.650065:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832632.650066:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787832632.650070:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787832632.650101:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787832632.650113:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832632.650115:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832632.650117:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787832632.650119:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787832632.650121:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832632.650122:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787832632.650124:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787832632.650125:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787832632.650282:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5868:1874678300804352:0@lo:502: 00000100:00100000:1.0:1787832632.650365:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832632.650461:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c42d3401 going to sleep for 11 seconds 00000100:00100000:3.0:1787832632.658946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804352 00000100:00100000:3.0:1787832632.658984:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804352 00000100:00100000:3.0:1787832632.659138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787832632.659158:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085818980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5868:x1874678300804352:12345-0@lo:502: 00000100:00100000:3.0:1787832632.659597:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085818980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5868:x1874678300804352:12345-0@lo:502: Request processed in 450us (9231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832632.659606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787832632.663311:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5868:1874678300804352:0@lo:502: 00000020:01000000:1.0:1787832632.663389:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832632.663400:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832632.663403:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787832632.663407:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787832632.663649:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787832632.663667:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787832632.663691:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.663729:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 0000000009de9ed2/0x72bd9178b14b6945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832632.663739:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3543878800 from 1 10000000:01000000:0.0:1787832632.663742:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787832632.663802:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.663812:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.663821:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832632.663853:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804480:0@lo:101: 00000100:00100000:0.0:1787832632.663931:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.666960:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8adce5a going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.667321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804480 00000100:00100000:2.0:1787832632.667332:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804480 00000100:00100000:2.0:1787832632.667380:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787832632.667387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19b8a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+9:5825:x1874678300804480:12345-0@lo:101: 00010000:00010000:2.0:1787832632.667404:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832632.667422:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6999 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.667449:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.667460:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.667468:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008bcf77b, rc 0) 00000100:00100000:2.0:1787832632.667526:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19b8a2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+10:5825:x1874678300804480:12345-0@lo:101: Request processed in 140us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.667533:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787832632.667651:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804480:0@lo:101: 00010000:00010000:0.0:1787832632.667677:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.667686:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832632.668573:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804608:0@lo:256: 00000100:00100000:0.0:1787832632.668627:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.668667:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8adce5a going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.668772:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804608 00000100:00100000:2.0:1787832632.668778:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804608 00000100:00100000:2.0:1787832632.668805:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832632.668811:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e2c6a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+10:5825:x1874678300804608:12345-0@lo:256: 20000000:01000000:2.0:1787832632.668827:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787832632.668902:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787832632.668989:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e2c6a07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+10:5825:x1874678300804608:12345-0@lo:256: Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.668996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787832632.670130:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804608:0@lo:256: 10000000:01000000:0.0:1787832632.670898:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787832632.670921:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.670933:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832632.670944:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3543878800 from 1 10000000:01000000:0.0:1787832632.670946:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787832632.670985:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.670994:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.671002:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832632.671022:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804736:0@lo:101: 00000100:00100000:0.0:1787832632.671084:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.671118:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8adce5a going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.671426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804736 00000100:00100000:2.0:1787832632.671434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804736 00000100:00100000:2.0:1787832632.671466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832632.671473:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cac9ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+10:5825:x1874678300804736:12345-0@lo:101: 00010000:00010000:2.0:1787832632.671484:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832632.671495:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b69a7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.671516:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.671525:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.671534:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1a3c89d, rc 0) 00000100:00100000:2.0:1787832632.671570:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cac9ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300804736:12345-0@lo:101: Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.671577:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832632.671662:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804736:0@lo:101: 00010000:00010000:0.0:1787832632.671673:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.671681:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832632.671745:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804864:0@lo:501: 00000100:00100000:0.0:1787832632.671876:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.671939:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8adce5a going to sleep for 11 seconds 00000100:00100000:3.0:1787832632.673667:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804864 00000100:00100000:3.0:1787832632.673679:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804864 00000100:00100000:2.0:1787832632.673799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832632.673808:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad72669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300804864:12345-0@lo:501: 00000100:00100000:2.0:1787832632.675959:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad72669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300804864:12345-0@lo:501: Request processed in 2146us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.675973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832632.676251:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804864:0@lo:501: 00000100:00100000:0.0:1787832632.676300:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804992:0@lo:503: 00000100:00100000:0.0:1787832632.676354:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.676397:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8adce5a going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.676609:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300804992 00000100:00100000:2.0:1787832632.676616:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300804992 00000100:00100000:2.0:1787832632.676652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787832632.676659:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068a323a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300804992:12345-0@lo:503: 00000040:00080000:2.0:1787832632.676734:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787832632.676914:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068a323a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300804992:12345-0@lo:503: Request processed in 255us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.676921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832632.677001:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300804992:0@lo:503: 00000040:00080000:0.0:1787832632.678598:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787832632.678933:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787832632.678961:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832632.678983:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.678995:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832632.679049:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787832632.679052:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3543878800 10000000:01000000:2.0:1787832632.679055:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3543878800 10000000:01000000:2.0:1787832632.679058:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787832632.679065:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3543878800 from 1 10000000:01000000:2.0:1787832632.679068:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787832632.679107:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679115:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679137:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832632.679173:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805120:0@lo:101: 00000100:00100000:2.0:1787832632.679246:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832632.679276:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed800a4d going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.679300:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805120 00000100:00100000:2.0:1787832632.679306:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805120 00000100:00100000:2.0:1787832632.679342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787832632.679349:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e4ad7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300805120:12345-0@lo:101: 00010000:00010000:2.0:1787832632.679363:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832632.679376:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b516460/0x72bd9178b14b69bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b69b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b516460/0x72bd9178b14b69bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679406:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b516460/0x72bd9178b14b69bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679414:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b516460, rc 0) 00000100:00100000:2.0:1787832632.679450:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e4ad7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805120:12345-0@lo:101: Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.679457:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787832632.679502:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805120:0@lo:101: 00010000:00010000:2.0:1787832632.679515:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.679533:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832632.679580:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805248:0@lo:501: 00000100:00100000:2.0:1787832632.679604:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832632.679617:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed800a4d going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.679629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805248 00000100:00100000:2.0:1787832632.679633:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805248 00000100:00100000:2.0:1787832632.679650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787832632.679656:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e738ef1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805248:12345-0@lo:501: 00000100:00100000:2.0:1787832632.679942:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e738ef1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805248:12345-0@lo:501: Request processed in 286us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.679949:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787832632.679977:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805248:0@lo:501: 00000100:00100000:2.0:1787832632.680005:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805376:0@lo:503: 00000100:00100000:2.0:1787832632.680044:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832632.680056:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed800a4d going to sleep for 11 seconds 00000100:00100000:2.0:1787832632.680067:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805376 00000100:00100000:2.0:1787832632.680070:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805376 00000100:00100000:2.0:1787832632.680086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787832632.680090:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047b5d51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805376:12345-0@lo:503: 00000100:00100000:2.0:1787832632.680366:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047b5d51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805376:12345-0@lo:503: Request processed in 274us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.680373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787832632.680411:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805376:0@lo:503: 00000100:00100000:2.0:1787832632.688299:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5873:1874678300805504:0@lo:502: 00000100:00100000:2.0:1787832632.688406:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832632.688503:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b2b6910 going to sleep for 11 seconds 00000100:00100000:1.0:1787832632.688552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805504 00000100:00100000:1.0:1787832632.688560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805504 00000100:00100000:1.0:1787832632.689306:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787832632.689318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5873:x1874678300805504:12345-0@lo:502: 00000100:00100000:1.0:1787832632.690132:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5873:x1874678300805504:12345-0@lo:502: Request processed in 815us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832632.690151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787832632.693236:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033aeaa9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5873:1874678300805504:0@lo:502: 00000020:01000004:3.0:1787832632.693445:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787832632.693480:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009f922836) 00000020:00000080:3.0:1787832632.693501:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787832632.693585:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000059e65187 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787832632.693589:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000059e65187 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787832632.693592:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000059e65187 4 00010000:00080000:3.0:1787832632.693621:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008b3a61b4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1787832632.695614:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787832632.701275:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787832632.701320:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787832632.701333:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bd9178b14b69ca 00000100:00080000:3.0:1787832632.701345:0:5873:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832632.701350:0:5873:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008b3a61b4 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832632.701386:0:5873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e310a8a0 x1874678300805632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787832632.701459:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300805632:0@lo:38: 00000100:00100000:2.0:1787832632.701529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787832632.701605:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787832632.701733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805632 00000100:00100000:0.0:1787832632.701742:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805632 00000100:00100000:0.0:1787832632.701787:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832632.701794:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033aeaa9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874678300805632:12345-0@lo:38: 00000100:00100000:0.0:1787832632.709521:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033aeaa9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874678300805632:12345-0@lo:38: Request processed in 7719us (7985us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787832632.709539:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832632.710199:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c011e8f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5873:1874678300805760:0@lo:502: 00000100:00100000:3.0:1787832632.710276:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832632.710323:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcbca1d9 going to sleep for 11 seconds 00000100:00100000:0.0:1787832632.710445:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805760 00000100:00100000:0.0:1787832632.710457:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805760 00000100:00100000:0.0:1787832632.710505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787832632.710513:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005953d6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5873:x1874678300805760:12345-0@lo:502: 00000100:00100000:0.0:1787832632.711026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005953d6ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5873:x1874678300805760:12345-0@lo:502: Request processed in 513us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832632.711035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787832632.718789:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787832632.718805:0:3304:0:(import.c:65:import_set_state_nolock()) 000000008b3a61b4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787832632.718814:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787832632.718818:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e310a8a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300805632:0@lo:38: 00000100:00100000:3.0:1787832632.719176:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c011e8f3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:5873:1874678300805760:0@lo:502: 00000040:00080000:3.0:1787832632.719252:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787832632.719437:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787832632.719456:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787832632.719468:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832632.719479:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000136e693b/0x72bd9178b14b69b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787832632.719528:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787832632.719530:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787832632.719532:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832632.719533:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832632.719534:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832632.719536:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832632.719537:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787832632.719538:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787832632.719540:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832632.719541:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832632.719543:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832632.719545:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832632.719549:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787832632.719551:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787832632.719553:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787832632.719554:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832632.719555:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832632.719556:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832632.719557:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832632.719558:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787832632.719559:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787832632.719565:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832632.719566:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832632.719566:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832632.719567:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832632.719591:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787832632.719605:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805888:0@lo:253: 00000100:00100000:0.0:1787832632.719671:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832632.719763:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7b9724b going to sleep for 11 seconds 00000100:00100000:1.0:1787832632.719916:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300805888 00000100:00100000:1.0:1787832632.719923:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300805888 00000100:00100000:1.0:1787832632.719971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787832632.719978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1421bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5825:x1874678300805888:12345-0@lo:253: 20000000:01000000:1.0:1787832632.720005:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787832632.720018:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787832632.835520:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787832632.835551:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787832632.837653:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787832632.837662:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787832632.837684:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832632.837724:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832632.837734:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832632.838164:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832632.838181:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 12 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832632.838195:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c011e8f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300806016:0@lo:104: 00000100:00100000:3.0:1787832632.838271:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832632.838420:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806016 00000100:00100000:2.0:1787832632.838428:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806016 00000100:00100000:2.0:1787832632.838475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832632.838483:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c5c9c13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300806016:12345-0@lo:104: 00010000:00010000:2.0:1787832632.838495:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.838555:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787832632.838560:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c5c9c13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300806016:12345-0@lo:104: Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832632.838568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832632.839691:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b0d3ff8 going to sleep for 11 seconds 00000100:00100000:3.0:1787832632.839747:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c011e8f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300806016:0@lo:104: 00010000:00010000:3.0:1787832632.839786:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841545:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832632.841559:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841572:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ca79cf0 already unused, calling callback (000000003d3a8389) 10000000:00010000:1.0:1787832632.841575:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841585:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832632.841592:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832632.841598:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787832632.841650:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841657:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832632.841694:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841720:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 000000003ca79cf0/0x72bd9178b14b6999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69a0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.841776:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832632.841778:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832632.841780:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832632.841904:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832632.841921:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300806144:0@lo:103: 00000100:00100000:1.0:1787832632.841988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832632.845554:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806144 00000100:00100000:1.0:1787832632.845569:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806144 00010000:00010000:1.0:1787832632.845607:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832632.845643:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832632.845651:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ec84b67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3305:x1874678300806144:12345-0@lo:103: 00010000:00010000:1.0:1787832632.845666:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832632.845670:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.845683:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.845719:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008bcf77b/0x72bd9178b14b69a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6999 expref: 13 pid: 5840 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.845735:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.845742:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787832632.845993:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008331644s 00010000:00010000:1.0:1787832632.845998:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846004:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846009:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846016:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846022:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000216b9046 already unused, calling callback (00000000860ff245) 00010000:00010000:1.0:1787832632.846025:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846044:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846067:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832632.846079:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832632.846153:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ec84b67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3305:x1874678300806144:12345-0@lo:103: Request processed in 502us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832632.846161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832632.846226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300806144:0@lo:103: 00010000:00010000:2.0:1787832632.846357:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.846366:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832632.846381:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000216b9046/0x72bd9178b14b69d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832632.854698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1421bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5825:x1874678300805888:12345-0@lo:253: Request processed in 134712us (135019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832632.856731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787832632.870854:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006310a65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:5825:1874678300805888:0@lo:253: 10000000:01000000:0.0:1787832632.870879:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787832632.870882:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787832632.870884:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787832632.870886:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832632.870887:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832632.870888:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832632.870890:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832632.870891:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787832632.870892:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787832632.870893:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832632.870895:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832632.870896:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832632.870897:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787832632.870910:0:5825:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787832632.875897:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832632.879746:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787832632.880018:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787832632.887342:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832632.897647:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832632.897962:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832632.905314:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832632.905918:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832632.906208:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832632.906379:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832632.906877:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832632.908111:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787832632.978512:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1787832633.036233:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787832633.043640:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787832633.043795:0:5878:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787832633.043800:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787832633.046859:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787832633.068243:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787832633.069854:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787832633.070537:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787832633.073539:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787832633.075246:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787832633.081319:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787832633.082138:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787832633.082180:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787832633.086834:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787832633.087139:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787832633.088405:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787832633.088565:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787832633.088732:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787832633.098301:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787832633.098984:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787832633.099170:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787832633.099331:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787832633.099505:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787832633.099657:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787832633.099877:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787832633.100052:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787832633.100226:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787832633.100399:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787832633.100553:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787832633.100745:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787832633.100916:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787832633.101227:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787832633.101381:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787832633.101548:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787832633.101732:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787832633.102913:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787832633.103184:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787832633.103341:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787832633.103511:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787832633.103816:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787832633.104008:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787832633.104158:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787832633.104325:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787832633.104804:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787832633.104990:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787832633.105990:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787832633.106235:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787832633.106737:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787832633.109911:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787832633.235808:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787832633.235861:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9aa481d67988 00100000:10000000:1.0:1787832633.235870:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787832633.243061:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787832633.243083:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787832633.243096:0:5825:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787832633.243145:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787832633.329034:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787832633.329146:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787832633.329170:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787832634.059847:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832635.084130:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832636.113485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832637.131914:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787832637.716420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787832637.716431:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787832637.716434:0:37:0:(import.c:65:import_set_state_nolock()) 000000008b3a61b4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787832637.716448:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008b3a61b4 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787832637.716472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f7740ce x1874678300806400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787832637.716569:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832637.716584:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300806272:0@lo:400: 00000100:00100000:0.0:1787832637.716656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832637.716737:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806272 00000100:00100000:0.0:1787832637.716755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806272 00000100:00100000:0.0:1787832637.716801:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787832637.716809:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9cde6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:3308:x1874678300806272:12345-0@lo:400: 00000100:00100000:0.0:1787832637.716861:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9cde6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:3308:x1874678300806272:12345-0@lo:400: Request processed in 53us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832637.716875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787832637.717002:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f7740ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300806400:0@lo:38: 00000100:00100000:2.0:1787832637.717035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832637.717065:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbd1ed2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300806272:0@lo:400: 00000100:00100000:0.0:1787832637.717134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806400 00000100:00100000:0.0:1787832637.717138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806400 00000100:00100000:0.0:1787832637.717164:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832637.717168:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000160eb53c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874678300806400:12345-0@lo:38: 00010000:00080000:0.0:1787832637.717189:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1787832637.717224:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bd9178b14b69d8 00000004:00100000:0.0:1787832637.717270:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787832637.717388:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000799ff6b9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832637.717425:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000160eb53c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874678300806400:12345-0@lo:38: Request processed in 255us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832637.717432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787832637.717505:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f7740ce x1874678300806400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787832637.717518:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787832637.717525:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787832637.717529:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787832637.717531:0:3304:0:(import.c:65:import_set_state_nolock()) 000000008b3a61b4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787832637.717535:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f7740ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300806400:0@lo:38: 00010000:00010000:3.0:1787832638.157439:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832638.417115:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1787832638.733689:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787832638.733697:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3543878800 from 3 10000000:01000000:1.0:1787832638.733733:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787832638.733778:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832638.733803:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832638.733823:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832638.733848:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1e2a7e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300806528:0@lo:101: 00000100:00100000:1.0:1787832638.733915:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832638.733951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806528 00000100:00100000:2.0:1787832638.733959:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806528 00000100:00100000:1.0:1787832638.733977:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e521d7a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787832638.734003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787832638.734011:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009224fd19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5842:x1874678300806528:12345-0@lo:101: 00010000:00010000:2.0:1787832638.734024:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832638.734037:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d317cf22/0x72bd9178b14b69e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b69df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832638.734060:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d317cf22/0x72bd9178b14b69e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b69df expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832638.734070:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d317cf22/0x72bd9178b14b69e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69df expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832638.734080:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d317cf22, rc 0) 00000100:00100000:2.0:1787832638.734325:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009224fd19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300806528:12345-0@lo:101: Request processed in 119us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832638.734340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832638.735167:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1e2a7e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300806528:0@lo:101: 00010000:00010000:1.0:1787832638.735187:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832638.735198:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832638.735261:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1e2a7e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300806656:0@lo:256: 00000100:00100000:1.0:1787832638.735312:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832638.735345:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e521d7a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787832638.736029:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806656 00000100:00100000:2.0:1787832638.736037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806656 00000100:00100000:2.0:1787832638.736080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832638.736088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bedcb132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300806656:12345-0@lo:256: 20000000:01000000:2.0:1787832638.736106:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787832638.736123:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787832638.736126:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787832638.736477:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bedcb132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300806656:12345-0@lo:256: Request processed in 388us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832638.736485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787832638.739454:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1e2a7e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300806656:0@lo:256: 10000000:01000000:3.0:1787832638.739526:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787832638.739535:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832638.739546:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: 00000000de00667c/0x72bd9178b14b69df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832639.189066:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832640.204017:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832641.231439:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832642.253874:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832642.828676:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832642.828718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832642.828718:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1cbe2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300806784:0@lo:400: 00000100:00100000:3.0:1787832642.828732:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4575873 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300806912:0@lo:400: 00000100:00100000:3.0:1787832642.830737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832642.830953:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806912 00000100:00100000:0.0:1787832642.830964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806912 00000100:00100000:0.0:1787832642.831020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832642.831029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c011e8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300806912:12345-0@lo:400: 00000100:00100000:0.0:1787832642.831099:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c011e8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300806912:12345-0@lo:400: Request processed in 71us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832642.831106:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787832642.831170:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e4575873 x1874678300806912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832642.831188:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4575873 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300806912:0@lo:400: 00000100:00100000:2.0:1787832642.831587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832642.831696:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300806784 00000100:00100000:0.0:1787832642.831727:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300806784 00000100:00100000:0.0:1787832642.831764:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787832642.831771:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddf9d9d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3307:x1874678300806784:12345-0@lo:400: 00000100:00100000:0.0:1787832642.831830:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddf9d9d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3307:x1874678300806784:12345-0@lo:400: Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832642.831837:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832642.831943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1cbe2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300806784:0@lo:400: 00010000:00010000:3.0:1787832643.276284:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787832643.325672:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9b1ee740 20000000:00000080:3.0:1787832643.325693:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3565e29800 uarg=0000000000000000 20000000:01000000:3.0:1787832643.325757:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787832643.325764:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787832643.325768:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787832643.325958:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787832643.325969:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787832643.331375:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832643.331665:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787832643.331857:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787832643.331913:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787832643.331931:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787832643.331949:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832643.331969:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832643.331977:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832643.332017:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832643.332032:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 11 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832643.332048:0:6323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f46e818 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1874678300807040:0@lo:104: 00000100:00100000:3.0:1787832643.332130:0:6323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832643.332182:0:6323:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ccb353 going to sleep for 11 seconds 00000100:00100000:1.0:1787832643.332189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807040 00000100:00100000:1.0:1787832643.332197:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807040 00000100:00100000:1.0:1787832643.332251:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832643.332260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000246289cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:6323:x1874678300807040:12345-0@lo:104: 00010000:00010000:1.0:1787832643.332272:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332343:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832643.332348:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000246289cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:6323:x1874678300807040:12345-0@lo:104: Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832643.332365:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787832643.332388:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832643.332393:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332400:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e8194a1 already unused, calling callback (000000003d3a8389) 10000000:00010000:1.0:1787832643.332403:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332410:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832643.332416:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832643.332421:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787832643.332426:0:6323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f46e818 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1874678300807040:0@lo:104: 00010000:00010000:2.0:1787832643.332443:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332448:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332454:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832643.332469:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332476:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: 000000009e8194a1/0x72bd9178b14b69a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832643.332484:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef6a1c21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300807168:0@lo:103: 00010000:00010000:1.0:1787832643.332491:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832643.332492:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832643.332494:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832643.332516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832643.332580:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807168 00000100:00100000:1.0:1787832643.332590:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807168 00010000:00010000:1.0:1787832643.332606:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 12 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832643.332635:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832643.332641:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4b0c95b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3306:x1874678300807168:12345-0@lo:103: 00010000:00010000:1.0:1787832643.332661:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832643.332665:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 12 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332673:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 12 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332684:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b69a7 expref: 12 pid: 5840 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332695:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332727:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332740:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332746:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332753:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332758:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332769:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068e9171e already unused, calling callback (00000000860ff245) 00010000:00010000:1.0:1787832643.332773:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332779:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332795:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832643.332804:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832643.332827:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832643.332834:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4b0c95b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:3306:x1874678300807168:12345-0@lo:103: Request processed in 195us (320us total) trans 0 rc 0/0 00010000:00010000:2.0:1787832643.332835:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832643.332841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787832643.332850:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068e9171e/0x72bd9178b14b69ed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832643.332998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef6a1c21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300807168:0@lo:103: 00010000:00010000:3.0:1787832644.299918:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832645.323976:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787832645.899976:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787832645.899985:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3543878800 from 1 10000000:01000000:1.0:1787832645.899990:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832645.900034:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: 00000000f893d1df/0x72bd9178b14b69f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832645.900046:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: 00000000f893d1df/0x72bd9178b14b69f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832645.900056:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: 00000000f893d1df/0x72bd9178b14b69f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832645.900083:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb6d9a7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807296:0@lo:101: 00000100:00100000:1.0:1787832645.900158:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832645.900223:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a9b0e8b going to sleep for 11 seconds 00000100:00100000:2.0:1787832645.900346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807296 00000100:00100000:2.0:1787832645.900354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807296 00000100:00100000:2.0:1787832645.900414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787832645.900422:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004111c9a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:5842:x1874678300807296:12345-0@lo:101: 00010000:00010000:2.0:1787832645.900435:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832645.900449:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b69f4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832645.900472:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832645.900482:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1a3c89d/0x72bd9178b14b69fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832645.900490:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1a3c89d, rc 0) 00000100:00100000:2.0:1787832645.900533:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004111c9a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300807296:12345-0@lo:101: Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832645.900540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787832645.900598:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb6d9a7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807296:0@lo:101: 00010000:00010000:2.0:1787832645.900621:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: 00000000f893d1df/0x72bd9178b14b69f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832645.900630:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: 00000000f893d1df/0x72bd9178b14b69f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832645.900687:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807424:0@lo:501: 00000100:00100000:2.0:1787832645.900742:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832645.900770:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068313a52 going to sleep for 11 seconds 00000100:00100000:2.0:1787832645.900784:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807424 00000100:00100000:2.0:1787832645.900788:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807424 00000100:00100000:2.0:1787832645.900810:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787832645.900816:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002dc6dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300807424:12345-0@lo:501: 00000100:00100000:2.0:1787832645.901050:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002dc6dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300807424:12345-0@lo:501: Request processed in 234us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832645.901057:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787832645.901085:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807424:0@lo:501: 00000100:00100000:2.0:1787832645.901113:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807552:0@lo:503: 00000100:00100000:2.0:1787832645.901149:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832645.901162:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de93b8b4 going to sleep for 11 seconds 00000100:00100000:2.0:1787832645.901172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807552 00000100:00100000:2.0:1787832645.901175:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807552 00000100:00100000:2.0:1787832645.901206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787832645.901212:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fb3db99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300807552:12345-0@lo:503: 00000100:00100000:2.0:1787832645.901347:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fb3db99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300807552:12345-0@lo:503: Request processed in 136us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832645.901354:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787832645.901388:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300807552:0@lo:503: 00000100:00100000:2.0:1787832645.901556:0:6409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6409:1874678300807680:0@lo:502: 00000100:00100000:2.0:1787832645.901587:0:6409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832645.901615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807680 00000100:00100000:2.0:1787832645.901619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807680 00000100:00100000:2.0:1787832645.901639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787832645.901644:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa50bf83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6409:x1874678300807680:12345-0@lo:502: 00000100:00100000:2.0:1787832645.901793:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa50bf83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6409:x1874678300807680:12345-0@lo:502: Request processed in 149us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832645.901799:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787832645.901825:0:6409:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ffa3e13 going to sleep for 11 seconds 00000100:00100000:2.0:1787832645.901835:0:6409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009156936d pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6409:1874678300807680:0@lo:502: 00000020:01000000:2.0:1787832645.901854:0:6409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832645.901862:0:6409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832645.901865:0:6409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787832645.901872:0:6409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3543878800 00000020:00000080:2.0:1787832645.901874:0:6409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787832645.901912:0:6409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6409:1874678300807808:0@lo:502: 00000100:00100000:2.0:1787832645.901941:0:6409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832645.901959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807808 00000100:00100000:2.0:1787832645.901963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807808 00000100:00100000:2.0:1787832645.901981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787832645.901987:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6409:x1874678300807808:12345-0@lo:502: 00000100:00100000:2.0:1787832645.902078:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6409:x1874678300807808:12345-0@lo:502: Request processed in 91us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832645.902085:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787832645.902110:0:6409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832645.902121:0:6409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6409:1874678300807808:0@lo:502: 00000020:01000000:2.0:1787832645.902137:0:6409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832645.902141:0:6409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832645.902142:0:6409:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787832645.902145:0:6409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787832645.902189:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787832645.902202:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832645.902215:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832645.902224:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832646.353929:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832647.380217:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832647.949925:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300807936:0@lo:400: 00000100:00100000:1.0:1787832647.950000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832647.950064:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832647.950070:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300808064:0@lo:400: 00000100:00100000:1.0:1787832647.950103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832647.950264:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808064 00000100:00100000:2.0:1787832647.950272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808064 00000100:00100000:2.0:1787832647.950315:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832647.950324:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300808064:12345-0@lo:400: 00000100:00100000:2.0:1787832647.950384:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300808064:12345-0@lo:400: Request processed in 61us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832647.950391:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787832647.950434:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c3560ce12c0 x1874678300808064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832647.950447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300808064:0@lo:400: 00000100:00100000:3.0:1787832647.950547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300807936 00000100:00100000:3.0:1787832647.950559:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300807936 00000100:00100000:3.0:1787832647.950602:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787832647.950609:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3307:x1874678300807936:12345-0@lo:400: 00000100:00100000:3.0:1787832647.950662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3307:x1874678300807936:12345-0@lo:400: Request processed in 54us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832647.950668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832647.950749:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300807936:0@lo:400: 00010000:00010000:3.0:1787832648.396051:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832649.423132:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787832650.439244:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787832650.439248:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787832650.439382:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c357c687800 00000020:01000004:2.0:1787832650.439398:0:6692:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787832650.439410:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787832650.439424:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c35738a19b8) 00000020:00000080:2.0:1787832650.439439:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1787832650.443949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787832650.457920:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787832650.458168:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787832650.499935:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787832650.507184:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787832650.507215:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787832650.507271:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787832650.507297:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787832650.507661:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787832650.507672:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787832650.507682:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bd9178b14b6a09 00000020:01000004:3.0:1787832650.507689:0:6692:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787832650.507740:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787832650.507744:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787832650.507751:0:6692:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787832650.507756:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787832650.507767:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c356547b370) 00000020:00000080:3.0:1787832650.507779:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787832650.514153:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832650.514346:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787832650.514357:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787832650.517621:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787832650.517635:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787832650.518424:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787832650.518431:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787832650.520588:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832650.520859:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787832650.520864:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787832650.521438:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787832650.521444:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787832650.553303:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832650.553632:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787832650.553640:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787832650.555613:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787832650.555624:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787832650.557909:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787832650.557930:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787832650.561039:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832650.561302:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787832650.561309:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787832650.564216:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787832650.564227:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787832650.600943:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832650.601148:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787832650.601156:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787832650.602222:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787832650.602232:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787832650.602662:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787832650.602687:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787832650.602693:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787832650.630153:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787832650.630193:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787832650.630198:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787832650.630200:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787832650.630202:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832650.630204:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832650.630205:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832650.630206:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832650.630208:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832650.630209:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787832650.630211:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787832650.630213:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832650.630215:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787832650.630219:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787832650.630221:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787832650.630223:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787832650.630224:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832650.630225:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832650.630226:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832650.630231:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832650.630232:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832650.630233:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787832650.630234:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787832650.630235:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832650.630235:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787832650.630269:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787832650.630288:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300808192:0@lo:253: 00000100:00100000:1.0:1787832650.630359:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.630539:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.630601:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808192 00000100:00100000:0.0:1787832650.630608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808192 00000100:00100000:0.0:1787832650.630655:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787832650.630665:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300808192:12345-0@lo:253: 20000000:01000000:0.0:1787832650.630730:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787832650.630735:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787832650.630741:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787832650.630744:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787832650.631597:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832650.631831:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787832650.631843:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787832650.631880:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787832650.631889:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787832650.631919:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787832650.631968:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787832650.632336:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787832650.632355:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:0.0:1787832650.632357:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1787832650.632391:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787832650.632398:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787832650.632441:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787832650.632451:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1787832650.632481:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787832650.632490:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787832650.632535:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787832650.632609:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787832650.633339:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787832650.633355:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:0.0:1787832650.633357:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:0.0:1787832650.633393:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787832650.633401:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787832650.633433:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787832650.633441:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:0.0:1787832650.633485:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787832650.633495:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787832650.633922:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787832650.633991:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787832650.634008:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787832650.634012:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787832650.634018:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787832650.634019:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787832650.634022:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787832650.634036:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787832650.634040:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787832650.634078:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787832650.634081:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787832650.634685:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787832650.634939:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787832650.634989:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787832650.635272:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787832650.635312:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787832650.635365:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787832650.635380:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787832650.635382:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787832650.635851:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787832650.635896:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787832650.635945:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787832650.636175:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787832650.636214:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787832650.636250:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787832650.636261:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787832650.636263:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787832650.636591:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787832650.636914:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787832650.636951:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787832650.637018:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787832650.637035:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787832650.637054:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637074:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637083:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637090:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637097:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637137:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637154:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.637168:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808320:0@lo:104: 00000100:00100000:0.0:1787832650.637234:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787832650.637326:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637334:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 12 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.637343:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808448:0@lo:104: 00000100:00100000:0.0:1787832650.637372:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787832650.637445:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.637455:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 12 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.637464:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808576:0@lo:104: 00000100:00100000:0.0:1787832650.637484:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.637554:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808320 00000100:00100000:3.0:1787832650.637562:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808320 00000100:00100000:3.0:1787832650.637594:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808448 00000100:00100000:3.0:1787832650.637597:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808448 00000100:00100000:3.0:1787832650.637612:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832650.637620:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:5840:x1874678300808320:12345-0@lo:104: 00010000:00010000:3.0:1787832650.637638:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637696:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832650.637723:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:5840:x1874678300808320:12345-0@lo:104: Request processed in 104us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.637731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832650.637748:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832650.637754:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5840:x1874678300808448:12345-0@lo:104: 00010000:00010000:3.0:1787832650.637761:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637792:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787832650.637796:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5840:x1874678300808448:12345-0@lo:104: Request processed in 44us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.637801:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787832650.637817:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832650.637824:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637831:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832650.637834:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637842:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832650.637849:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.637860:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832650.637889:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637895:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832650.637913:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637919:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74d000/0x72bd9178b14b69b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637931:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832650.637934:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637939:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832650.637942:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637947:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832650.637953:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.637958:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832650.637969:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637975:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832650.637986:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.637994:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215d600/0x72bd9178b14b6945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b694c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638004:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.638006:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.638008:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832650.638027:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300808704:0@lo:103: 00000100:00100000:3.0:1787832650.638057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.638080:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832650.638086:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300808832:0@lo:103: 00000100:00100000:3.0:1787832650.638104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.638135:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808704 00000100:00100000:3.0:1787832650.638139:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808704 00010000:00010000:3.0:1787832650.638155:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 13 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832650.638174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808832 00000100:00100000:3.0:1787832650.638177:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808832 00010000:00010000:3.0:1787832650.638187:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 14 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832650.638199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832650.638205:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3305:x1874678300808704:12345-0@lo:103: 00010000:00010000:3.0:1787832650.638214:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832650.638218:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638239:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638254:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832650.638280:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3305:x1874678300808704:12345-0@lo:103: Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.638286:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832650.638299:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832650.638304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3305:x1874678300808832:12345-0@lo:103: 00010000:00010000:3.0:1787832650.638312:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832650.638317:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638326:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638335:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832650.638354:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3305:x1874678300808832:12345-0@lo:103: Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.638360:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832650.638395:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300808832:0@lo:103: 00000100:00100000:3.0:1787832650.638403:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300808704:0@lo:103: 00010000:00010000:1.0:1787832650.638482:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832650.638567:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c355ce619c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787832650.638580:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b69bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b69b5 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.638590:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808320:0@lo:104: 00010000:00010000:0.0:1787832650.638599:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b694c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6945 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.638608:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808448:0@lo:104: 00000100:00100000:3.0:1787832650.638652:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808576 00000100:00100000:3.0:1787832650.638656:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808576 00000100:00100000:3.0:1787832650.638674:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832650.638680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5840:x1874678300808576:12345-0@lo:104: 00010000:00010000:3.0:1787832650.638695:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.638876:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832650.638881:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5840:x1874678300808576:12345-0@lo:104: Request processed in 202us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.638888:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787832650.638927:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832650.638932:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.638939:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832650.638943:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.638950:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832650.638956:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832650.638961:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787832650.638990:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.638996:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832650.639011:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540031c00/0x72bd9178b14b6929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6930 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832650.639045:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832650.639047:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832650.639058:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300808960:0@lo:103: 00000100:00100000:1.0:1787832650.639099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.639136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300808960 00000100:00100000:1.0:1787832650.639140:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300808960 00010000:00010000:1.0:1787832650.639157:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.639176:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832650.639182:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:3307:x1874678300808960:12345-0@lo:103: 00010000:00010000:1.0:1787832650.639190:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832650.639194:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639204:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639218:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639225:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639238:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639250:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639256:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639262:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639268:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832650.639272:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639279:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639288:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.639298:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832650.639327:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:3307:x1874678300808960:12345-0@lo:103: Request processed in 146us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832650.639333:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832650.639358:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300808960:0@lo:103: 00010000:00010000:0.0:1787832650.639564:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6929 expref: 10 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.639575:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1874678300808576:0@lo:104: 00010000:00010000:0.0:1787832650.639595:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.639604:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.639610:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.639623:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787832650.639638:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787832650.680205:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+9:6692:x1874678300808192:12345-0@lo:253: Request processed in 49532us (49835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.680221:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832650.680306:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300808192:0@lo:253: 10000000:01000000:1.0:1787832650.680322:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787832650.680325:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787832650.680327:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787832650.680328:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832650.680342:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787832650.680344:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832650.680345:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832650.680346:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832650.680348:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787832650.680350:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832650.680352:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787832650.680380:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c357c687800 from lustre-OST0000 10000000:01000000:1.0:1787832650.680407:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787832650.680409:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787832650.680416:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c3543794d28 local copy 10000000:01000000:1.0:1787832650.680420:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787832650.680455:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.680467:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.680476:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.680493:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809088:0@lo:101: 00000100:00100000:1.0:1787832650.680542:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.680639:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.680826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809088 00000100:00100000:2.0:1787832650.680832:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809088 00000100:00100000:2.0:1787832650.680912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787832650.680923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:6692:x1874678300809088:12345-0@lo:101: 00010000:00010000:2.0:1787832650.680935:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832650.680948:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a1e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.680979:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a1e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.680990:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a1e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.680998:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c800, rc 0) 00000100:00100000:2.0:1787832650.681039:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+10:6692:x1874678300809088:12345-0@lo:101: Request processed in 118us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.681045:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787832650.681107:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809088:0@lo:101: 00010000:00010000:1.0:1787832650.681120:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681129:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.681228:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809216:0@lo:501: 00000100:00100000:1.0:1787832650.681262:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.681345:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832650.681422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809216 00000100:00100000:3.0:1787832650.681427:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809216 00000100:00100000:3.0:1787832650.681450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787832650.681456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+10:6692:x1874678300809216:12345-0@lo:501: 00000100:00100000:3.0:1787832650.681667:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+10:6692:x1874678300809216:12345-0@lo:501: Request processed in 210us (403us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832650.681675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787832650.681773:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809216:0@lo:501: 10000000:01000000:1.0:1787832650.681788:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787832650.681813:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787832650.681818:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681828:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681836:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681859:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787832650.681878:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c357c687800 10000000:01000000:1.0:1787832650.681883:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787832650.681888:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c3543794d28 10000000:01000000:1.0:1787832650.681891:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787832650.681894:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c3543794d28 from 1 10000000:01000000:1.0:1787832650.681897:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787832650.681914:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681923:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.681931:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.681955:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809344:0@lo:101: 00000100:00100000:1.0:1787832650.681980:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.681999:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb780 going to sleep for 11 seconds 00010000:00010000:3.0:1787832650.682120:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832650.682127:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682134:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832650.682138:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682146:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832650.682153:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.682158:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832650.682182:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682188:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832650.682216:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682224:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d4400/0x72bd9178b14b6a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6a25 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682239:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.682241:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.682243:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832650.682251:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832650.682261:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300809472:0@lo:103: 00000100:00100000:3.0:1787832650.682288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.682314:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809472 00000100:00100000:3.0:1787832650.682318:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809472 00000100:00100000:3.0:1787832650.682346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832650.682353:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+10:3307:x1874678300809472:12345-0@lo:103: 00010000:00010000:3.0:1787832650.682362:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832650.682374:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6a1e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682389:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832650.682415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+9:3307:x1874678300809472:12345-0@lo:103: Request processed in 62us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.682422:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832650.682447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300809472:0@lo:103: 00000100:00100000:3.0:1787832650.682461:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809344 00000100:00100000:3.0:1787832650.682470:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809344 00000100:00100000:3.0:1787832650.682485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787832650.682491:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+9:6692:x1874678300809344:12345-0@lo:101: 00010000:00010000:3.0:1787832650.682500:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832650.682509:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215d600/0x72bd9178b14b6a33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a2c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682538:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215d600/0x72bd9178b14b6a33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a2c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682548:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215d600/0x72bd9178b14b6a33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a2c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682554:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215d600, rc 0) 00000100:00100000:3.0:1787832650.682584:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+10:6692:x1874678300809344:12345-0@lo:101: Request processed in 93us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.682590:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787832650.682620:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809344:0@lo:101: 00010000:00010000:3.0:1787832650.682632:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682640:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.682655:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787832650.682665:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682673:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.682686:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787832650.682881:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787832650.682887:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787832650.682889:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787832650.682905:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682913:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.682921:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832650.682933:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809600:0@lo:101: 00000100:00100000:3.0:1787832650.682958:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.682977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809600 00000100:00100000:3.0:1787832650.682980:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809600 00000100:00100000:3.0:1787832650.682996:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787832650.683002:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+10:6692:x1874678300809600:12345-0@lo:101: 00010000:00010000:3.0:1787832650.683008:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832650.683016:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a3a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.683029:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.683038:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.683056:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215d800, rc 0) 00000100:00100000:3.0:1787832650.683080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809600:12345-0@lo:101: Request processed in 78us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.683086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787832650.683112:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832650.683124:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809600:0@lo:101: 00010000:00010000:3.0:1787832650.683134:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.683142:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832650.683212:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809728:0@lo:501: 00000100:00100000:3.0:1787832650.683249:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.683269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809728 00000100:00100000:3.0:1787832650.683273:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809728 00000100:00100000:3.0:1787832650.683291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787832650.683296:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809728:12345-0@lo:501: 00000100:00100000:3.0:1787832650.683475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809728:12345-0@lo:501: Request processed in 177us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.683482:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787832650.683502:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832650.683514:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809728:0@lo:501: 00000100:00100000:3.0:1787832650.683553:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809856:0@lo:503: 00000100:00100000:3.0:1787832650.683587:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.683613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809856 00000100:00100000:3.0:1787832650.683617:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809856 00000100:00100000:3.0:1787832650.683633:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787832650.683638:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809856:12345-0@lo:503: 00000100:00100000:3.0:1787832650.683983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809856:12345-0@lo:503: Request processed in 343us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.683991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787832650.684024:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832650.684036:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809856:0@lo:503: 00000040:00080000:3.0:1787832650.684280:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787832650.684341:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809984:0@lo:502: 00000100:00100000:3.0:1787832650.684373:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.684401:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.684457:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300809984 00000100:00100000:2.0:1787832650.684462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300809984 00000100:00100000:2.0:1787832650.684494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787832650.684501:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809984:12345-0@lo:502: 00000100:00100000:2.0:1787832650.684645:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300809984:12345-0@lo:502: Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.684652:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787832650.684892:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300809984:0@lo:502: 00000040:00080000:3.0:1787832650.685136:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787832650.685183:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787832650.685216:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787832650.685262:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787832650.685295:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787832650.685330:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787832650.685356:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810112:0@lo:502: 00000100:00100000:3.0:1787832650.685395:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.685553:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.685615:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810112 00000100:00100000:0.0:1787832650.685620:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810112 00000100:00100000:2.0:1787832650.685675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787832650.685685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300810112:12345-0@lo:502: 00000100:00100000:2.0:1787832650.685874:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300810112:12345-0@lo:502: Request processed in 190us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.685882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787832650.686059:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810112:0@lo:502: 00000040:00080000:3.0:1787832650.686145:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787832650.686156:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787832650.686643:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787832650.686656:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787832650.686665:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832650.686667:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787832650.686673:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787832650.686691:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c3565478000) 00000020:00000080:3.0:1787832650.686747:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787832650.686754:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787832650.686812:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357c687800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787832650.686819:0:6711:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787832650.686825:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bd9178b14b6a4f 00010000:00010000:2.0:1787832650.691124:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787832650.691447:0:6711:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787832650.694506:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787832650.694960:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787832650.701344:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787832650.702259:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787832650.703480:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787832650.703492:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832650.703498:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832650.703501:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787832650.703504:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832650.703508:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832650.703510:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787832650.703513:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787832650.703530:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787832650.703581:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832650.703584:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832650.703585:0:6711:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787832650.703589:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787832650.707931:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787832650.707981:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787832650.708010:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.708024:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832650.708033:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357c687800 from 1 10000000:01000000:1.0:1787832650.708035:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832650.708077:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.708086:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.708098:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.708123:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810240:0@lo:101: 00000100:00100000:1.0:1787832650.708192:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.708234:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.708344:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810240 00000100:00100000:2.0:1787832650.708351:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810240 00000100:00100000:2.0:1787832650.708390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787832650.708398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:6692:x1874678300810240:12345-0@lo:101: 00010000:00010000:2.0:1787832650.708411:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832650.708424:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a56 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.708447:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.708457:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.708467:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74ce00, rc 0) 00000100:00100000:2.0:1787832650.708514:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810240:12345-0@lo:101: Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.708546:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787832650.710675:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810240:0@lo:101: 00010000:00010000:1.0:1787832650.710738:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.710759:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.710881:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810368:0@lo:501: 00000100:00100000:1.0:1787832650.710935:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.710973:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.711091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810368 00000100:00100000:2.0:1787832650.711098:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810368 00000100:00100000:2.0:1787832650.711136:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832650.711144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810368:12345-0@lo:501: 00000100:00100000:2.0:1787832650.711372:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810368:12345-0@lo:501: Request processed in 228us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.711380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787832650.711546:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810368:0@lo:501: 00000100:00100000:1.0:1787832650.711573:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810496:0@lo:503: 00000100:00100000:1.0:1787832650.711611:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.711637:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.711680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810496 00000100:00100000:2.0:1787832650.711684:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810496 00000100:00100000:2.0:1787832650.711894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787832650.711902:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810496:12345-0@lo:503: 00000100:00100000:2.0:1787832650.712105:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810496:12345-0@lo:503: Request processed in 203us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.712112:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787832650.712862:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810496:0@lo:503: 00000040:00080000:1.0:1787832650.713141:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787832650.713217:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810624:0@lo:502: 00000100:00100000:1.0:1787832650.713265:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.715228:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.715314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810624 00000100:00100000:0.0:1787832650.715323:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810624 00000100:00100000:0.0:1787832650.715365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787832650.715374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810624:12345-0@lo:502: 00000100:00100000:0.0:1787832650.715660:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810624:12345-0@lo:502: Request processed in 285us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.715668:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787832650.715863:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810624:0@lo:502: 00000040:00080000:1.0:1787832650.716170:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787832650.716228:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787832650.716261:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810752:0@lo:502: 00000100:00100000:1.0:1787832650.716305:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.716330:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.716462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810752 00000100:00100000:0.0:1787832650.716467:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810752 00000100:00100000:0.0:1787832650.716489:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787832650.716496:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810752:12345-0@lo:502: 00000100:00100000:0.0:1787832650.716645:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810752:12345-0@lo:502: Request processed in 148us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.716653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787832650.716814:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810752:0@lo:502: 00000040:00080000:1.0:1787832650.716896:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787832650.716907:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787832650.717385:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832650.717395:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832650.717398:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787832650.717404:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357c687800 00000020:00000080:0.0:1787832650.717412:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832650.717434:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832650.717438:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832650.717439:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787832650.717442:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787832650.717577:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787832650.717598:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787832650.717620:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.717632:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832650.717666:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787832650.717669:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c357c687800 10000000:01000000:1.0:1787832650.717673:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c357c687800 10000000:01000000:1.0:1787832650.717677:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787832650.717682:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357c687800 from 1 10000000:01000000:1.0:1787832650.717685:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787832650.717819:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.717828:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.717838:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.717855:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810880:0@lo:101: 00000100:00100000:1.0:1787832650.717899:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.717926:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.718002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300810880 00000100:00100000:2.0:1787832650.718008:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300810880 00000100:00100000:2.0:1787832650.718039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787832650.718046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300810880:12345-0@lo:101: 00010000:00010000:2.0:1787832650.718058:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832650.718070:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.718092:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.718103:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.718121:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c800, rc 0) 00000100:00100000:2.0:1787832650.718158:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300810880:12345-0@lo:101: Request processed in 111us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.718165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787832650.718248:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300810880:0@lo:101: 00010000:00010000:1.0:1787832650.718261:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832650.718282:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832650.718355:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811008:0@lo:501: 00000100:00100000:1.0:1787832650.718380:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.718405:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.718474:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811008 00000100:00100000:0.0:1787832650.718479:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811008 00000100:00100000:0.0:1787832650.718498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787832650.718506:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811008:12345-0@lo:501: 00000100:00100000:0.0:1787832650.718820:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811008:12345-0@lo:501: Request processed in 314us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.718827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787832650.719863:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811008:0@lo:501: 00000100:00100000:1.0:1787832650.719908:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811136:0@lo:503: 00000100:00100000:1.0:1787832650.719965:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832650.719996:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832650.720074:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811136 00000100:00100000:0.0:1787832650.720079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811136 00000100:00100000:0.0:1787832650.720116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787832650.720124:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811136:12345-0@lo:503: 00000100:00100000:0.0:1787832650.720299:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811136:12345-0@lo:503: Request processed in 175us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.720307:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787832650.720445:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811136:0@lo:503: 00000040:00080000:3.0:1787832650.721026:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787832650.721101:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811264:0@lo:502: 00000100:00100000:3.0:1787832650.721143:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.721211:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c34418946c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.721245:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811264 00000100:00100000:2.0:1787832650.721249:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811264 00000100:00100000:2.0:1787832650.721312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787832650.721322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811264:12345-0@lo:502: 00000100:00100000:2.0:1787832650.721493:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811264:12345-0@lo:502: Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.721500:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787832650.721578:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811264:0@lo:502: 00000040:00080000:3.0:1787832650.721930:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787832650.721979:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787832650.722012:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787832650.722057:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787832650.722092:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787832650.722145:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787832650.722193:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787832650.722228:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787832650.722274:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787832650.722308:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787832650.722340:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787832650.722385:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787832650.722417:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787832650.722447:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787832650.722504:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787832650.722559:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787832650.722594:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787832650.722653:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787832650.722692:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787832650.722758:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787832650.722805:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787832650.722840:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787832650.722889:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787832650.722950:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787832650.722990:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787832650.723024:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787832650.723071:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787832650.723107:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787832650.723143:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811392:0@lo:502: 00000100:00100000:3.0:1787832650.723202:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.723585:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c34418946c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.723663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811392 00000100:00100000:2.0:1787832650.723669:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811392 00000100:00100000:2.0:1787832650.724045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787832650.724055:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811392:12345-0@lo:502: 00000100:00100000:2.0:1787832650.724307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811392:12345-0@lo:502: Request processed in 253us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.724315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787832650.724627:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811392:0@lo:502: 00000040:00080000:3.0:1787832650.725162:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787832650.725179:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787832650.726340:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787832650.726355:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c3543793370) 00000020:00000080:0.0:1787832650.726376:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787832650.726452:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357c687800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787832650.726456:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c357c687800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787832650.726459:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357c687800 3 00010000:00080000:0.0:1787832650.726486:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c357b9ea000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787832650.729201:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787832650.729457:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787832650.729497:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787832650.729512:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bd9178b14b6a79 00000100:00080000:1.0:1787832650.729533:0:6716:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787832650.729539:0:6716:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c357b9ea000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787832650.729576:0:6716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3560c821c0 x1874678300811520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787832650.729605:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787832650.729925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300811520:0@lo:38: 00000100:00100000:2.0:1787832650.729999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832650.730200:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300811648:0@lo:400: 00000100:00100000:2.0:1787832650.730227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832650.730291:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811520 00000100:00100000:0.0:1787832650.730298:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811520 00000100:00100000:0.0:1787832650.730330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811648 00000100:00100000:0.0:1787832650.730333:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811648 00000100:00100000:0.0:1787832650.730366:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832650.730375:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300811648:12345-0@lo:400: 00000100:00100000:0.0:1787832650.730428:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300811648:12345-0@lo:400: Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.730436:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832650.730452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832650.730456:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874678300811520:12345-0@lo:38: 00010000:00080000:0.0:1787832650.730478:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787832650.730511:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bd9178b14b6a80 00000004:00100000:0.0:1787832650.730537:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787832650.730572:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832650.730610:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874678300811520:12345-0@lo:38: Request processed in 152us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832650.730618:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787832650.730656:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c3560c821c0 x1874678300811520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832650.730667:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832650.730675:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787832650.730682:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787832650.730687:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787832650.730689:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787832650.730695:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300811520:0@lo:38: 00010000:00080000:0.0:1787832650.730826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c354b71a1c0 x1874678300811648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832650.730836:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300811648:0@lo:400: 00000040:00080000:1.0:1787832650.731073:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787832650.731314:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787832650.731341:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787832650.731363:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.731375:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787832650.731416:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787832650.731419:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787832650.731421:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832650.731422:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832650.731424:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832650.731425:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832650.731427:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832650.731429:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832650.731430:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832650.731432:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832650.731433:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832650.731437:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787832650.731440:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787832650.731441:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787832650.731443:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832650.731444:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832650.731445:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832650.731446:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832650.731448:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832650.731449:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832650.731450:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832650.731451:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832650.731452:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832650.731469:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787832650.731481:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811776:0@lo:253: 00000100:00100000:0.0:1787832650.731534:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832650.731567:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35432e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832650.731613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811776 00000100:00100000:2.0:1787832650.731619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811776 00000100:00100000:2.0:1787832650.731654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787832650.731662:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6692:x1874678300811776:12345-0@lo:253: 20000000:01000000:2.0:1787832650.731696:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787832650.731814:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787832650.757689:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787832650.757739:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787832650.757895:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787832650.757913:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787832650.757933:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.757954:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69df expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.757963:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.758008:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.758022:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 13 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.758038:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300811904:0@lo:104: 00000100:00100000:0.0:1787832650.758106:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832650.758160:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3543058b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832650.758223:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300811904 00000100:00100000:3.0:1787832650.758231:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300811904 00000100:00100000:3.0:1787832650.758280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832650.758290:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300811904:12345-0@lo:104: 00010000:00010000:3.0:1787832650.758303:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758356:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832650.758362:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300811904:12345-0@lo:104: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832650.758370:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787832650.758397:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832650.758403:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758411:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5800 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832650.758415:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758425:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832650.758433:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832650.758440:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832650.758468:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758476:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832650.758492:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758499:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5800/0x72bd9178b14b69df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758528:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.758530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832650.758532:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832650.758551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300812032:0@lo:103: 00000100:00100000:3.0:1787832650.758582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832650.758614:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812032 00000100:00100000:3.0:1787832650.758623:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812032 00010000:00010000:3.0:1787832650.758639:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832650.758660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832650.758666:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3306:x1874678300812032:12345-0@lo:103: 00010000:00010000:3.0:1787832650.758676:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832650.758682:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.758692:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832650.758838:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300811904:0@lo:104: 00010000:00010000:3.0:1787832650.758948:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74da00/0x72bd9178b14b69e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b69df expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.759513:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.759606:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832650.759617:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787832650.759911:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008331644s 00010000:00010000:2.0:1787832650.759918:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759927:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759935:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759943:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759949:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832650.759955:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759964:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759985:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832650.759994:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832650.760057:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3306:x1874678300812032:12345-0@lo:103: Request processed in 1390us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.760071:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787832650.760196:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300812032:0@lo:103: 00010000:00010000:0.0:1787832650.760258:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.760267:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832650.760274:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6a87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832650.766349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:6692:x1874678300811776:12345-0@lo:253: Request processed in 34676us (34803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832650.766382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787832650.766462:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:6692:1874678300811776:0@lo:253: 10000000:01000000:0.0:1787832650.766481:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787832650.766484:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787832650.766486:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787832650.766488:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832650.766489:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832650.766491:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832650.769866:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832650.769869:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832650.769871:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832650.769872:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832650.769874:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832650.769876:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787832650.769900:0:6692:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787832650.779596:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787832650.780146:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787832650.780377:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787832650.780559:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787832650.781128:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787832650.781328:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787832650.782538:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787832651.000253:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787832651.000261:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787832651.000312:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787832651.000372:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787832651.000387:0:6692:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787832651.000404:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:3.0:1787832651.340087:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787832651.340096:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3543878800 from 21 10000000:01000000:3.0:1787832651.340101:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787832651.340153:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.340166:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.340176:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832651.340207:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812160:0@lo:101: 00000100:00100000:3.0:1787832651.340278:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832651.340323:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3550841180 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.340346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812160 00000100:00100000:3.0:1787832651.340352:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812160 00000100:00100000:3.0:1787832651.340395:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832651.340402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300812160:12345-0@lo:101: 00010000:00010000:3.0:1787832651.340415:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832651.340427:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a8e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.340683:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.340695:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.340819:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215c000, rc 0) 00000100:00100000:3.0:1787832651.340867:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812160:12345-0@lo:101: Request processed in 465us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.340874:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787832651.340951:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812160:0@lo:101: 00010000:00010000:0.0:1787832651.340975:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.340985:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832651.341041:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812288:0@lo:501: 00000100:00100000:0.0:1787832651.341075:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832651.341100:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354639a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.341193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812288 00000100:00100000:3.0:1787832651.341197:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812288 00000100:00100000:3.0:1787832651.341226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787832651.341232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812288:12345-0@lo:501: 00000100:00100000:3.0:1787832651.342833:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812288:12345-0@lo:501: Request processed in 1595us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.342853:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787832651.342915:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812288:0@lo:501: 00000100:00100000:3.0:1787832651.343556:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812416:0@lo:503: 00000100:00100000:3.0:1787832651.343675:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832651.343699:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3550841600 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.343749:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812416 00000100:00100000:3.0:1787832651.343754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812416 00000100:00100000:3.0:1787832651.343790:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787832651.343799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812416:12345-0@lo:503: 00000100:00100000:3.0:1787832651.346629:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812416:12345-0@lo:503: Request processed in 2821us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.346644:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787832651.349592:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812416:0@lo:503: 00000100:00100000:3.0:1787832651.350167:0:6734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6734:1874678300812544:0@lo:502: 00000100:00100000:3.0:1787832651.350241:0:6734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832651.350283:0:6734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3550841600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832651.350327:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812544 00000100:00100000:0.0:1787832651.350334:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812544 00000100:00100000:0.0:1787832651.350385:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787832651.350396:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6734:x1874678300812544:12345-0@lo:502: 00000100:00100000:0.0:1787832651.351172:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6734:x1874678300812544:12345-0@lo:502: Request processed in 775us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832651.351181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787832651.356110:0:6734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6734:1874678300812544:0@lo:502: 00000100:00100000:2.0:1787832651.356201:0:6734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6734:1874678300812672:0@lo:502: 00000100:00100000:2.0:1787832651.356279:0:6734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832651.357606:0:6734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354649e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.360868:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812672 00000100:00100000:3.0:1787832651.361085:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812672 00000100:00100000:2.0:1787832651.364921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787832651.364935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6734:x1874678300812672:12345-0@lo:502: 00000100:00100000:2.0:1787832651.365234:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:6734:x1874678300812672:12345-0@lo:502: Request processed in 301us (8954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832651.365243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787832651.369081:0:6734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6734:1874678300812672:0@lo:502: 00000040:00080000:3.0:1787832651.369132:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787832651.375056:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787832651.375092:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787832651.375105:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.375118:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832651.383221:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787832651.383229:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3543878800 from 4 10000000:01000000:0.0:1787832651.383234:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787832651.383281:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.383293:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.383305:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832651.383330:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812800:0@lo:101: 00000100:00100000:0.0:1787832651.383396:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832651.384258:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354639a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.386834:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812800 00000100:00100000:3.0:1787832651.386848:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812800 00000100:00100000:3.0:1787832651.389591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787832651.389616:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300812800:12345-0@lo:101: 00010000:00010000:3.0:1787832651.389637:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832651.389659:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6a9c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.390088:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.390101:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.390112:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215ca00, rc 0) 00000100:00100000:3.0:1787832651.390203:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300812800:12345-0@lo:101: Request processed in 598us (6806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.390210:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787832651.390319:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812800:0@lo:101: 00010000:00010000:0.0:1787832651.390340:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.390362:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832651.390457:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812928:0@lo:256: 00000100:00100000:0.0:1787832651.390501:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832651.390552:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354639a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.391277:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300812928 00000100:00100000:3.0:1787832651.391285:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300812928 00000100:00100000:3.0:1787832651.391328:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787832651.391338:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300812928:12345-0@lo:256: 20000000:01000000:3.0:1787832651.391354:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787832651.391372:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787832651.391375:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787832651.391476:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300812928:12345-0@lo:256: Request processed in 139us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.391483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787832651.391561:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300812928:0@lo:256: 10000000:01000000:1.0:1787832651.391621:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787832651.391628:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.391636:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832651.391644:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787832651.391647:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787832651.391650:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787832651.391673:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.391681:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.391689:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832651.391741:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813056:0@lo:101: 00000100:00100000:1.0:1787832651.391769:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.391793:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.392148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813056 00000100:00100000:3.0:1787832651.392153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813056 00000100:00100000:3.0:1787832651.392187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787832651.392194:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300813056:12345-0@lo:101: 00010000:00010000:3.0:1787832651.392202:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832651.392213:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6aaa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.392242:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.392251:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.392260:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215d400, rc 0) 00000100:00100000:3.0:1787832651.392291:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300813056:12345-0@lo:101: Request processed in 99us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.392298:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787832651.392325:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813056:0@lo:101: 00010000:00010000:3.0:1787832651.392336:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832651.392344:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832651.392389:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813184:0@lo:501: 00000100:00100000:3.0:1787832651.392412:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832651.392439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813184 00000100:00100000:3.0:1787832651.392442:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813184 00000100:00100000:3.0:1787832651.392457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787832651.392462:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300813184:12345-0@lo:501: 00000100:00100000:3.0:1787832651.394046:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300813184:12345-0@lo:501: Request processed in 1577us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.394057:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787832651.394113:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35508413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.394130:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813184:0@lo:501: 00000100:00100000:3.0:1787832651.394166:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813312:0@lo:503: 00000100:00100000:3.0:1787832651.394207:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832651.394232:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35508413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832651.394302:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813312 00000100:00100000:0.0:1787832651.394308:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813312 00000100:00100000:0.0:1787832651.394345:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787832651.394353:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300813312:12345-0@lo:503: 00000100:00100000:0.0:1787832651.395128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300813312:12345-0@lo:503: Request processed in 773us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832651.395136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787832651.395413:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300813312:0@lo:503: 00000100:00100000:1.0:1787832651.396516:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6738:1874678300813440:0@lo:502: 00000100:00100000:1.0:1787832651.396587:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.396624:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832651.396675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813440 00000100:00100000:3.0:1787832651.396681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813440 00000100:00100000:3.0:1787832651.396745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787832651.396755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:6738:x1874678300813440:12345-0@lo:502: 00000100:00100000:3.0:1787832651.397049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:6738:x1874678300813440:12345-0@lo:502: Request processed in 296us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.397057:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787832651.397364:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6738:1874678300813440:0@lo:502: 00000020:01000000:1.0:1787832651.397390:0:6738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787832651.397397:0:6738:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787832651.397404:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832651.397407:0:6738:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787832651.397412:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787832651.397416:0:6738:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:1.0:1787832651.397439:0:6738:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787832651.397441:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787832651.397468:0:6738:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c3550bb8000) 00000020:00000080:1.0:1787832651.397488:0:6738:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787832651.397494:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787832651.397574:0:6738:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787832651.397579:0:6738:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787832651.397585:0:6738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b6abf 00010000:00080000:1.0:1787832651.397614:0:6738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3581970000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:1.0:1787832651.397894:0:6738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:3.0:1787832651.467970:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787832651.476607:0:6738:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787832651.476635:0:6738:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787832651.477266:0:6738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787832651.477441:0:6738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787832651.477494:0:6738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787832651.477582:0:6738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787832651.478246:0:6741:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832651.478251:0:6741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787832651.482959:0:6738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787832651.482979:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787832651.483010:0:6738:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787832651.483026:0:6738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b6ac6 00000100:00080000:3.0:1787832651.483036:0:6738:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832651.483040:0:6738:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3581970000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832651.483072:0:6738:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3560ce2580 x1874678300813568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787832651.483091:0:6738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787832651.483125:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300813568:0@lo:8: 00000100:00100000:0.0:1787832651.483202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832651.483417:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300813696:0@lo:400: 00000100:00100000:1.0:1787832651.483423:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813568 00000100:00100000:0.0:1787832651.483447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.483478:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813568 00000100:00100000:1.0:1787832651.483522:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832651.483522:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832651.483527:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300813824:0@lo:400: 00000100:00100000:1.0:1787832651.483530:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874678300813568:12345-0@lo:8: 00000100:00100000:0.0:1787832651.483550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787832651.483553:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1787832651.483648:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b6acd 00002000:00100000:1.0:1787832651.483678:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c356516d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787832651.483683:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787832651.483690:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787832651.483787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813696 00000100:00100000:2.0:1787832651.483792:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813696 00000100:00100000:2.0:1787832651.483822:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813824 00000100:00100000:2.0:1787832651.483825:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813824 00000020:01000000:3.0:1787832651.483826:0:6738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832651.483831:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832651.483832:0:6738:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787832651.483835:0:6738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1787832651.483847:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:3.0:1787832651.483848:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832651.483849:0:6738:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787832651.483853:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:2.0:1787832651.483853:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b7183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300813696:12345-0@lo:400: 00000020:00000080:3.0:1787832651.483855:0:6738:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787832651.483874:0:6738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6738:1874678300813952:0@lo:502: 00000100:00100000:2.0:1787832651.483899:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b7183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300813696:12345-0@lo:400: Request processed in 46us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832651.483906:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832651.483921:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832651.483927:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b7192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300813824:12345-0@lo:400: 00000100:00100000:2.0:1787832651.483955:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b7192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300813824:12345-0@lo:400: Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832651.483961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787832651.483977:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787832651.484055:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b58b480 x1874678300813824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.484067:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300813824:0@lo:400: 00010000:00080000:0.0:1787832651.484075:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b588f00 x1874678300813696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.484093:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300813696:0@lo:400: 00002000:00100000:1.0:1787832651.484142:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787832651.484246:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787832651.484264:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c356516f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832651.484302:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874678300813568:12345-0@lo:8: Request processed in 772us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832651.484310:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832651.484396:0:6738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787832651.484464:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560ce2580 x1874678300813568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787832661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.484473:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832651.484479:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787832651.484487:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787832651.484491:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:3.0:1787832651.484492:0:6738:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354377f240 going to sleep for 11 seconds 00000100:00080000:0.0:1787832651.484493:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3581970000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787832651.484520:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787832651.484525:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300813568:0@lo:8: 00000004:00080000:3.0:1787832651.484545:0:6741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787832651.484795:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300813952 00000100:00100000:2.0:1787832651.484800:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300813952 00000100:00100000:2.0:1787832651.484829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787832651.484837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:6738:x1874678300813952:12345-0@lo:502: 00000004:00080000:3.0:1787832651.485029:0:6741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174513325989ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787832651.485896:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:6738:x1874678300813952:12345-0@lo:502: Request processed in 1047us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832651.485907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787832651.487740:0:6738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:6738:1874678300813952:0@lo:502: 00000020:01000000:1.0:1787832651.487784:0:6738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832651.487792:0:6738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832651.487794:0:6738:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787832651.487800:0:6738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787832651.487938:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787832651.487955:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787832651.487972:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.487990:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832651.487998:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787832651.488000:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3543794d28 from 1 10000000:01000000:1.0:1787832651.488002:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787832651.488029:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.488035:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.488041:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832651.488055:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300814080:0@lo:101: 00000100:00100000:1.0:1787832651.488098:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.488131:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832651.488143:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814080 00000100:00100000:0.0:1787832651.488149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814080 00000100:00100000:0.0:1787832651.488191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787832651.488201:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300814080:12345-0@lo:101: 00010000:00010000:0.0:1787832651.488213:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832651.488225:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6ad4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.488250:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.488261:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.488269:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832651.488313:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300814080:12345-0@lo:101: Request processed in 114us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832651.488374:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300814080:0@lo:101: 00010000:00010000:1.0:1787832651.488386:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832651.488395:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832651.488435:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300814208:0@lo:501: 00000100:00100000:0.0:1787832651.488452:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787832651.488460:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.488497:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832651.488499:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814208 00000100:00100000:0.0:1787832651.488514:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814208 00000100:00100000:0.0:1787832651.488542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787832651.488548:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300814208:12345-0@lo:501: 00000100:00100000:1.0:1787832651.488830:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300814208:12345-0@lo:501: Request processed in 281us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787832651.488838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787832651.488841:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300814208:0@lo:501: 10000000:01000000:0.0:1787832651.488860:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787832651.488866:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832651.488874:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787832651.554284:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787832651.618058:0:6742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787832651.618098:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814464:0@lo:7: 00000100:00100000:1.0:1787832651.618171:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.618224:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1787832651.618259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300814336:0@lo:13: 00000100:00100000:1.0:1787832651.618284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.618326:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814464 00000100:00100000:1.0:1787832651.618333:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814464 00000100:00100000:1.0:1787832651.618385:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832651.618394:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1874678300814464:12345-0@lo:7: 00000100:00080000:3.0:1787832651.622967:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832651.622996:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814336 00000100:00100000:3.0:1787832651.623004:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814336 00000100:00100000:3.0:1787832651.623122:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832651.623134:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300814336:12345-0@lo:13: 00002000:00000024:3.0:1787832651.623162:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1787832651.623465:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300814336:12345-0@lo:13: Request processed in 333us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832651.623473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787832651.624405:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c81680 x1874678300814336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.624441:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300814336:0@lo:13: 00002000:00080000:1.0:1787832651.634850:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787832651.634860:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787832651.635638:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1874678300814464:12345-0@lo:7: Request processed in 17240us (17462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832651.635652:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787832651.638619:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c81a40 x1874678300814464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787832667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832651.638641:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814464:0@lo:7: 00000004:00080000:2.0:1787832651.638660:0:6742:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787832651.638726:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814592:0@lo:5: 00000100:00100000:2.0:1787832651.638785:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832651.638908:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c355880bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832651.640564:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814592 00000100:00100000:1.0:1787832651.640575:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814592 00000100:00100000:1.0:1787832651.640678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787832651.640690:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6742:x1874678300814592:12345-0@lo:5: 00002000:00080000:1.0:1787832651.640742:0:6696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787832651.640746:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787832651.641324:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6742:x1874678300814592:12345-0@lo:5: Request processed in 635us (2536us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787832651.641346:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787832651.641788:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b5892c0 x1874678300814592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787832667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.641808:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814592:0@lo:5: 00000004:00080000:0.0:1787832651.641824:0:6742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787832651.641865:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814720:0@lo:700: 00000100:00100000:0.0:1787832651.641925:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832651.641970:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354875e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787832651.643249:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814720 00000100:00100000:2.0:1787832651.643259:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814720 00000100:00100000:2.0:1787832651.643314:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832651.643326:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6742:x1874678300814720:12345-0@lo:700: 00000100:00100000:2.0:1787832651.643376:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874678300814848:0@lo:700: 00000100:00100000:2.0:1787832651.643426:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832651.643451:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c355880bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832651.643474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814848 00000100:00100000:2.0:1787832651.643477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814848 00000100:00100000:1.0:1787832651.644511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832651.644524:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874678300814848:12345-0@lo:700: 40000000:02000000:2.0:1787832651.737788:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787832651.750920:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1874678300814848:12345-0@lo:700: Request processed in 106389us (107483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832651.750952:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787832651.750972:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b589a40 x1874678300814848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787832667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832651.750990:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1874678300814848:0@lo:700: 40000000:02000000:1.0:1787832651.751004:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787832651.851033:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787832651.851055:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787832651.851821:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6742:x1874678300814720:12345-0@lo:700: Request processed in 208492us (209897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832651.851835:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787832651.852059:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b718f00 x1874678300814720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787832667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832651.852075:0:6742:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787832651.852093:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814720:0@lo:700: 00000004:02000040:0.0:1787832651.872396:0:6742:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787832651.875167:0:6742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814976:0@lo:5: 00000100:00100000:1.0:1787832651.875243:0:6742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832651.875331:0:6742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832651.875385:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300814976 00000100:00100000:0.0:1787832651.875393:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300814976 00000100:00100000:0.0:1787832651.875492:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787832651.875511:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6742:x1874678300814976:12345-0@lo:5: 00002000:00080000:1.0:1787832651.879490:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787832651.879521:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787832651.881669:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1874678300814976:12345-0@lo:5: Request processed in 6154us (6419us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787832651.881682:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787832651.881738:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c81a40 x1874678300814976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787832667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832651.881758:0:6742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1874678300814976:0@lo:5: 00000004:00080000:2.0:1787832651.881774:0:6742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787832652.492001:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832653.519027:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832654.543736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832655.564036:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832656.587816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832656.651888:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300815104:0@lo:400: 00000100:00100000:0.0:1787832656.651965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832656.652019:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300815616:0@lo:400: 00000100:00100000:0.0:1787832656.652048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832656.652072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787832656.652078:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300815488:0@lo:13: 00000100:00100000:0.0:1787832656.652102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832656.652129:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300815232:0@lo:400: 00000100:00100000:0.0:1787832656.652153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832656.652170:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832656.652175:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300815360:0@lo:400: 00000100:00100000:0.0:1787832656.652194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832656.652215:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815616 00000100:00100000:0.0:1787832656.652219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815104 00000100:00100000:2.0:1787832656.652222:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815616 00000100:00100000:0.0:1787832656.652222:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815104 00000100:00100000:2.0:1787832656.652265:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832656.652265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787832656.652273:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300815616:12345-0@lo:400: 00000100:00100000:0.0:1787832656.652276:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300815104:12345-0@lo:400: 00000100:00100000:2.0:1787832656.652322:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300815616:12345-0@lo:400: Request processed in 49us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832656.652322:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300815104:12345-0@lo:400: Request processed in 45us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832656.652330:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832656.652330:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787832656.652350:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815232 00000100:00100000:2.0:1787832656.652354:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815232 00000100:00100000:0.0:1787832656.652361:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815488 00000100:00100000:0.0:1787832656.652364:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815488 00000100:00100000:2.0:1787832656.652375:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815360 00000100:00100000:2.0:1787832656.652377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815360 00000100:00100000:0.0:1787832656.652382:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832656.652388:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300815488:12345-0@lo:13: 00000100:00100000:2.0:1787832656.652391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787832656.652396:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300815232:12345-0@lo:400: 00002000:00000024:0.0:1787832656.652428:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832656.652442:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300815232:12345-0@lo:400: Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832656.652448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787832656.652457:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300815488:12345-0@lo:13: Request processed in 70us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832656.652460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787832656.652463:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832656.652465:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300815360:12345-0@lo:400: 00000100:00100000:2.0:1787832656.652491:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300815360:12345-0@lo:400: Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832656.652497:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787832656.652527:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787832656.652530:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832656.652562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b71b840 x1874678300815360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832656.652575:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300815360:0@lo:400: 00010000:00080000:2.0:1787832656.652586:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b71a1c0 x1874678300815232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832656.652594:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300815232:0@lo:400: 00010000:00080000:2.0:1787832656.652625:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b589a40 x1874678300815488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832656.652638:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300815488:0@lo:13: 00000100:00100000:2.0:1787832656.652647:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300815104:0@lo:400: 00010000:00080000:2.0:1787832656.652655:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c355cf661c0 x1874678300815616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832656.652662:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300815616:0@lo:400: 00000001:00080000:2.0:1787832657.284824:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:3.0:1787832657.300579:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787832657.612133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832658.641297:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832659.659950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832660.684781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832661.708297:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832661.771971:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300815872:0@lo:400: 00000100:00100000:3.0:1787832661.772045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832661.772109:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832661.772117:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300815744:0@lo:400: 00000100:00100000:3.0:1787832661.772155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832661.772195:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300816000:0@lo:400: 00000100:00100000:3.0:1787832661.772233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832661.772274:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832661.772281:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300816128:0@lo:400: 00000100:00100000:3.0:1787832661.772316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832661.772403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815872 00000100:00100000:3.0:1787832661.772410:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815872 00000100:00100000:3.0:1787832661.772454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816000 00000100:00100000:3.0:1787832661.772457:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816000 00000100:00100000:3.0:1787832661.772486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787832661.772495:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300815872:12345-0@lo:400: 00000100:00100000:0.0:1787832661.772699:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816128 00000100:00100000:0.0:1787832661.772736:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816128 00000100:00100000:0.0:1787832661.772769:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832661.772777:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300816128:12345-0@lo:400: 00000100:00100000:0.0:1787832661.772822:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300816128:12345-0@lo:400: Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832661.772830:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832661.772992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300815872:12345-0@lo:400: Request processed in 497us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832661.772998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787832661.773012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787832661.773018:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300816000:12345-0@lo:400: 00000100:00100000:3.0:1787832661.773045:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300816000:12345-0@lo:400: Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832661.773050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787832661.773069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300815744 00000100:00100000:3.0:1787832661.773072:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300815744 00000100:00100000:3.0:1787832661.773097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787832661.773103:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3308:x1874678300815744:12345-0@lo:400: 00000100:00100000:3.0:1787832661.773130:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3308:x1874678300815744:12345-0@lo:400: Request processed in 28us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832661.773136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787832661.773167:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787832661.773171:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787832661.773201:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560ce3480 x1874678300816128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832661.773225:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787832661.773243:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300816128:0@lo:400: 00010000:00080000:3.0:1787832661.773255:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560ce12c0 x1874678300816000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832661.773262:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300816000:0@lo:400: 00000100:00100000:0.0:1787832661.773334:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300815744:0@lo:400: 00010000:00080000:0.0:1787832661.773347:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560ce3c00 x1874678300815872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832661.773356:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300815872:0@lo:400: 00000100:00100000:0.0:1787832661.774904:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300816256:0@lo:13: 00000100:00100000:0.0:1787832661.774959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832661.775050:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816256 00000100:00100000:1.0:1787832661.775057:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816256 00000100:00100000:1.0:1787832661.775100:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787832661.775110:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300816256:12345-0@lo:13: 00002000:00000024:1.0:1787832661.775144:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832661.775189:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300816256:12345-0@lo:13: Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832661.775201:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787832661.775287:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c821c0 x1874678300816256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832661.775304:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300816256:0@lo:13: 00010000:00010000:1.0:1787832662.731829:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832663.756551:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832664.779849:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832665.808421:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832666.828075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832666.892522:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832666.892570:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300816384:0@lo:13: 00000100:00100000:0.0:1787832666.892671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832666.893182:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816384 00000100:00100000:2.0:1787832666.893194:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816384 00000100:00080000:3.0:1787832666.893272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832666.893293:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832666.893309:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300816384:12345-0@lo:13: 00002000:00000024:2.0:1787832666.893373:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832666.893517:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300816384:12345-0@lo:13: Request processed in 214us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832666.893525:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787832666.893718:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b58b480 x1874678300816384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832666.893742:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300816384:0@lo:13: 00000100:00100000:2.0:1787832666.894296:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300816640:0@lo:400: 00000100:00100000:2.0:1787832666.894350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832666.894388:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832666.894394:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300816512:0@lo:400: 00000100:00100000:2.0:1787832666.894423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832666.894464:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816512 00000100:00100000:2.0:1787832666.894469:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816512 00000100:00100000:2.0:1787832666.894510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787832666.894519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300816512:12345-0@lo:400: 00000100:00100000:2.0:1787832666.894565:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300816512:12345-0@lo:400: Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832666.894572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787832666.894657:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300816768:0@lo:400: 00000100:00100000:0.0:1787832666.894689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832666.894773:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300816512:0@lo:400: 00000100:00100000:1.0:1787832666.903086:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816640 00000100:00100000:1.0:1787832666.903110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816640 00000100:00100000:1.0:1787832666.903185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816768 00000100:00100000:1.0:1787832666.903190:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816768 00000100:00100000:1.0:1787832666.903267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787832666.903280:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300816640:12345-0@lo:400: 00000100:00080000:0.0:1787832666.903319:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832666.903433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300816640:12345-0@lo:400: Request processed in 155us (9081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832666.903441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787832666.903461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832666.903468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300816768:12345-0@lo:400: 00000100:00100000:1.0:1787832666.903508:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300816768:12345-0@lo:400: Request processed in 42us (8819us total) trans 0 rc 0/0 00010000:00080000:0.0:1787832666.903508:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c82d00 x1874678300816640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832666.903515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787832666.903528:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300816640:0@lo:400: 00010000:00080000:1.0:1787832666.903545:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560c82580 x1874678300816768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832666.903555:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300816768:0@lo:400: 00010000:00010000:3.0:1787832667.855672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832668.875878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832669.915459:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787832670.310602:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787832670.310607:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787832670.311206:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c357b0a1800 00000020:01000004:1.0:1787832670.311231:0:7630:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787832670.311245:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787832670.311263:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c3550bb99b8) 00000020:00000080:1.0:1787832670.311279:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787832670.342922:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787832670.343364:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787832670.392005:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787832670.400291:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787832670.400457:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787832670.400566:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787832670.400593:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787832670.401186:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787832670.401202:0:7630:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787832670.401216:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bd9178b14b6ae9 00000020:01000004:3.0:1787832670.401226:0:7630:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787832670.401251:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787832670.401254:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787832670.401259:0:7630:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787832670.401278:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787832670.401282:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787832670.427671:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787832670.429327:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787832670.429339:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787832670.429341:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832670.429343:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832670.429344:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832670.429346:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832670.429347:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832670.429349:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832670.429364:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787832670.429366:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787832670.429369:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832670.429473:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832670.429480:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787832670.429483:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787832670.429485:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832670.429486:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832670.429487:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832670.429488:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832670.429490:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832670.429491:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832670.429492:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787832670.429493:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787832670.429494:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832670.429495:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832670.429592:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787832670.429735:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300816896:0@lo:253: 00000100:00100000:2.0:1787832670.430028:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.430304:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300816896 00000100:00100000:3.0:1787832670.430320:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300816896 00000100:00100000:3.0:1787832670.430526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787832670.430538:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:7630:x1874678300816896:12345-0@lo:253: 20000000:01000000:3.0:1787832670.430580:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787832670.430586:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787832670.430592:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787832670.430597:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:2.0:1787832670.430955:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af549c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787832670.447997:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787832670.448288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787832670.448306:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787832670.448345:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787832670.448352:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787832670.448395:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787832670.448448:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787832670.448927:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787832670.448953:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:2.0:1787832670.448956:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:2.0:1787832670.448994:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787832670.449003:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787832670.449064:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787832670.449073:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:2.0:1787832670.449109:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787832670.449127:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787832670.449156:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787832670.455566:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787832670.465535:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787832670.465595:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.134@tcp 20000000:01000000:2.0:1787832670.465599:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.134@tcp (null) (null) (null) 00000040:00080000:2.0:1787832670.466344:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787832670.466360:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787832670.466473:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787832670.466482:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.134@tcp (null) (null) 00000040:00080000:2.0:1787832670.466514:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787832670.466525:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787832670.466599:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787832670.469307:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787832670.469363:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787832670.469368:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787832670.470348:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787832670.470450:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787832670.470455:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787832670.471493:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787832670.471599:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787832670.478017:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787832670.479321:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787832670.479390:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787832670.479480:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787832670.479496:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787832670.479510:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787832670.481571:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787832670.482050:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787832670.482116:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787832670.487447:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787832670.487587:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787832670.488229:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787832670.488260:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787832670.488264:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787832670.495604:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787832670.496582:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787832670.506664:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787832670.507678:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787832670.507770:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787832670.507809:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787832670.507824:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787832670.507827:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787832670.511304:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787832670.511486:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787832670.512046:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787832670.513117:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787832670.513207:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787832670.513279:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787832670.513300:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787832670.513304:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787832670.513316:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787832670.513342:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.513366:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.514270:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.514278:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.514286:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.514294:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.514304:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.515216:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.515238:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.515257:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817024:0@lo:104: 00000100:00100000:2.0:1787832670.515366:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787832670.515691:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.515699:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 16 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.515721:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817152:0@lo:104: 00010000:00010000:2.0:1787832670.516066:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.516075:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 16 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.516083:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817280:0@lo:104: 00010000:00010000:2.0:1787832670.516115:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.516123:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 16 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.516130:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817408:0@lo:104: 00010000:00010000:2.0:1787832670.516155:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.516184:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 16 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.516192:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817536:0@lo:104: 00000100:00100000:2.0:1787832670.516232:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832670.516330:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787832670.516356:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832670.516390:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832670.516399:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832670.516409:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.516416:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817024 00000100:00100000:0.0:1787832670.516426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817152 00000100:00100000:3.0:1787832670.516427:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817024 00000100:00100000:0.0:1787832670.516427:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817152 00000100:00100000:3.0:1787832670.516478:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817280 00000100:00100000:3.0:1787832670.516482:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817280 00000100:00100000:0.0:1787832670.516546:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817408 00000100:00100000:0.0:1787832670.516551:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817408 00000100:00100000:0.0:1787832670.516573:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817536 00000100:00100000:0.0:1787832670.516577:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817536 00000100:00100000:0.0:1787832670.516591:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787832670.516601:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354643c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+7:5839:x1874678300817024:12345-0@lo:104: 00010000:00010000:0.0:1787832670.516616:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.516691:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832670.516699:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354643c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+7:5839:x1874678300817024:12345-0@lo:104: Request processed in 99us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.516722:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787832670.516740:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832670.516755:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516763:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.516778:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516788:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.516793:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 10000000:00010000:1.0:1787832670.516796:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.516800:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5839:x1874678300817152:12345-0@lo:104: 10000000:01000000:1.0:1787832670.516803:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832670.516807:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516850:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516858:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832670.516864:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832670.516869:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+6:5839:x1874678300817152:12345-0@lo:104: Request processed in 70us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.516875:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787832670.516879:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516886:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6adb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.516889:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832670.516896:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:5839:x1874678300817408:12345-0@lo:104: 00010000:00010000:0.0:1787832670.516902:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516903:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832670.516906:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516912:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.516921:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.516927:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787832670.516930:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.516931:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:5839:x1874678300817408:12345-0@lo:104: Request processed in 37us (531us total) trans 0 rc 0/0 10000000:00010000:1.0:1787832670.516937:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.516943:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787832670.516945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832670.516957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787832670.516958:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.516962:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:5839:x1874678300817536:12345-0@lo:104: 00010000:00010000:1.0:1787832670.516964:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832670.516969:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516982:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.516989:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.516995:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787832670.516999:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:5839:x1874678300817536:12345-0@lo:104: Request processed in 37us (588us total) trans 0 rc 0/0 00010000:00010000:1.0:1787832670.517000:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787832670.517003:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.517004:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787832670.517009:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.517012:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.517018:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.517028:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787832670.517036:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.517041:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787832670.517046:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787832670.517058:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.517059:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300817792:0@lo:103: 00010000:00010000:1.0:1787832670.517064:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832670.517069:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.517076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d4600/0x72bd9178b14b6a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a6b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.517085:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.517087:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832670.517087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832670.517089:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832670.517101:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300817664:0@lo:103: 00000100:00100000:0.0:1787832670.517116:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300817920:0@lo:103: 00000100:00100000:1.0:1787832670.517128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.517977:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817024:0@lo:104: 00000100:00100000:2.0:1787832670.517990:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817152:0@lo:104: 00000100:00100000:2.0:1787832670.517999:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817408:0@lo:104: 00000100:00100000:2.0:1787832670.518006:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817536:0@lo:104: 00000100:00100000:0.0:1787832670.518557:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817792 00000100:00100000:0.0:1787832670.518564:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817792 00010000:00010000:0.0:1787832670.518598:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 17 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.518636:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817664 00000100:00100000:0.0:1787832670.518639:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817664 00010000:00010000:0.0:1787832670.518651:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 18 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.518661:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832670.518663:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787832670.518664:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832670.518666:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832670.518670:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3306:x1874678300817792:12345-0@lo:103: 00010000:00010000:0.0:1787832670.518694:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832670.518714:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 18 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518726:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 18 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518756:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6aaa expref: 18 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518784:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832670.518841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:3306:x1874678300817792:12345-0@lo:103: Request processed in 171us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.518855:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787832670.518872:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832670.518878:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3308:x1874678300817664:12345-0@lo:103: 00010000:00010000:0.0:1787832670.518886:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832670.518891:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518899:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518909:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6ad4 expref: 16 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.518918:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832670.518951:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:3308:x1874678300817664:12345-0@lo:103: Request processed in 74us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.518957:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832670.518990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832670.518996:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.519005:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215c800 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.519010:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.519019:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.519033:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300817792:0@lo:103: 10000000:00010000:1.0:1787832670.519035:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.519041:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787832670.519065:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300817920 00000100:00100000:0.0:1787832670.519068:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300817920 00010000:00010000:1.0:1787832670.519072:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.519078:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 15 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.519079:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832670.519091:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.519094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832670.519099:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:3306:x1874678300817920:12345-0@lo:103: 00010000:00010000:1.0:1787832670.519100:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215c800/0x72bd9178b14b6a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a41 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.519107:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832670.519110:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 15 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.519112:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.519114:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.519115:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832670.519119:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 15 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.519127:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300818048:0@lo:103: 00010000:00010000:0.0:1787832670.519128:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74c800/0x72bd9178b14b6a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6a64 expref: 15 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.519136:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832670.519162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3306:x1874678300817920:12345-0@lo:103: Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.519168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832670.519206:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300817920:0@lo:103: 00000100:00100000:1.0:1787832670.519237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.519335:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300817664:0@lo:103: 00000100:00100000:0.0:1787832670.519465:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818048 00000100:00100000:0.0:1787832670.519470:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818048 00010000:00010000:0.0:1787832670.519486:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 14 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832670.519514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787832670.519529:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3307:x1874678300818048:12345-0@lo:103: 00000100:00100000:3.0:1787832670.519537:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787832670.519539:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832670.519543:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 14 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832670.519547:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5839:x1874678300817280:12345-0@lo:104: 00010000:00010000:0.0:1787832670.519551:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 14 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.519557:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.519561:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6a3a expref: 14 pid: 5837 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.519571:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832670.519599:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3307:x1874678300818048:12345-0@lo:103: Request processed in 71us (363us total) trans 0 rc 0/0 00010000:00010000:3.0:1787832670.519604:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832670.519604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787832670.519609:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5839:x1874678300817280:12345-0@lo:104: Request processed in 65us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832670.519615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787832670.519628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300818048:0@lo:103: 00000100:00100000:3.0:1787832670.519658:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1874678300817280:0@lo:104: 00010000:00010000:3.0:1787832670.519698:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520073:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832670.520080:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520088:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.520092:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520099:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832670.520116:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.520121:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787832670.520157:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520181:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832670.520200:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520208:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6a8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a95 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520224:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.520226:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.520228:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832670.520336:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300818176:0@lo:103: 00000100:00100000:3.0:1787832670.520386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.520520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818176 00000100:00100000:1.0:1787832670.520525:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818176 00010000:00010000:1.0:1787832670.520543:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.520573:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832670.520580:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3308:x1874678300818176:12345-0@lo:103: 00010000:00010000:1.0:1787832670.520590:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832670.520595:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520605:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520634:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6a8e expref: 13 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520648:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520658:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520675:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520682:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520689:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520695:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520719:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215da00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832670.520724:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520732:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520755:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.520786:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832670.520820:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3308:x1874678300818176:12345-0@lo:103: Request processed in 241us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.521100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787832670.521128:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.521136:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.521142:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6af0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787832670.521169:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787832670.521223:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300818176:0@lo:103: 00000100:00100000:1.0:1787832670.663490:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+11:7630:x1874678300816896:12345-0@lo:253: Request processed in 232940us (233447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.663510:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787832670.663844:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300816896:0@lo:253: 10000000:01000000:2.0:1787832670.663866:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787832670.663869:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787832670.663871:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832670.663873:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832670.663875:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787832670.663876:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832670.663877:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832670.663879:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832670.663881:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787832670.663883:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832670.663885:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787832670.663913:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c357b0a1800 from lustre-OST0001 10000000:01000000:2.0:1787832670.663946:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787832670.663949:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787832670.663960:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c3543794d28 local copy 10000000:01000000:2.0:1787832670.663964:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787832670.664015:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.664028:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.664064:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.664088:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818304:0@lo:101: 00000100:00100000:2.0:1787832670.664140:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.664235:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.664665:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818304 00000100:00100000:1.0:1787832670.664673:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818304 00000100:00100000:1.0:1787832670.664759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787832670.664777:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+11:7630:x1874678300818304:12345-0@lo:101: 00010000:00010000:1.0:1787832670.664794:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832670.664814:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6af7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.665027:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6af7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.665055:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6af7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.665066:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c35429d4600, rc 0) 00000100:00100000:1.0:1787832670.665121:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818304:12345-0@lo:101: Request processed in 346us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.665128:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787832670.665208:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818304:0@lo:101: 00010000:00010000:1.0:1787832670.665228:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.665239:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.665390:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818432:0@lo:501: 00000100:00100000:1.0:1787832670.665431:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.665451:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098780 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.665471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818432 00000100:00100000:1.0:1787832670.665476:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818432 00000100:00100000:1.0:1787832670.665503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832670.665511:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818432:12345-0@lo:501: 00000100:00100000:1.0:1787832670.666371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818432:12345-0@lo:501: Request processed in 847us (925us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787832670.666383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832670.666482:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818432:0@lo:501: 10000000:01000000:1.0:1787832670.666510:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787832670.666550:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787832670.666557:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.666567:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.666574:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.666732:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787832670.666780:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c357b0a1800 10000000:01000000:1.0:1787832670.666787:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787832670.666794:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787832670.666797:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787832670.666802:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787832670.666806:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787832670.667013:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.667022:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.667034:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.667055:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818560:0@lo:101: 00000100:00100000:1.0:1787832670.667095:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.667139:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.667330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818560 00000100:00100000:2.0:1787832670.667337:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818560 00000100:00100000:2.0:1787832670.667392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787832670.667411:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818560:12345-0@lo:101: 00010000:00010000:2.0:1787832670.667424:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832670.667439:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b05 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.667465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.667476:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.667485:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d600, rc 0) 00000100:00100000:2.0:1787832670.667528:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300818560:12345-0@lo:101: Request processed in 127us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.667534:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787832670.668027:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818560:0@lo:101: 00010000:00010000:1.0:1787832670.668059:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.668068:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.668193:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818688:0@lo:501: 00000100:00100000:1.0:1787832670.668231:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.668264:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.668314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818688 00000100:00100000:2.0:1787832670.668318:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818688 00000100:00100000:2.0:1787832670.668355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787832670.668362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300818688:12345-0@lo:501: 00000100:00100000:2.0:1787832670.668669:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300818688:12345-0@lo:501: Request processed in 307us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.668678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787832670.669299:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818688:0@lo:501: 00000100:00100000:1.0:1787832670.669348:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818816:0@lo:503: 00000100:00100000:1.0:1787832670.669426:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.669465:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.669603:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818816 00000100:00100000:2.0:1787832670.669609:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818816 00000100:00100000:2.0:1787832670.669662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787832670.669672:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300818816:12345-0@lo:503: 00000100:00100000:2.0:1787832670.670145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300818816:12345-0@lo:503: Request processed in 473us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.670154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787832670.670354:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818816:0@lo:503: 00000040:00080000:1.0:1787832670.671103:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787832670.671317:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818944:0@lo:502: 00000100:00100000:1.0:1787832670.671696:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.672003:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00010000:00010000:0.0:1787832670.672313:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832670.672325:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.672337:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832670.672342:0:7636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.672355:0:7636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832670.672363:0:7636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832670.672409:0:7636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832670.673043:0:7636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.673054:0:7636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832670.673093:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.673101:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74dc00/0x72bd9178b14b6af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72bd9178b14b6afe expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.673120:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832670.673122:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832670.673124:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832670.673260:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300819072:0@lo:103: 00000100:00100000:1.0:1787832670.673327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832670.673592:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819072 00000100:00100000:0.0:1787832670.673601:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819072 00000100:00100000:0.0:1787832670.673946:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832670.673959:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3305:x1874678300819072:12345-0@lo:103: 00010000:00010000:0.0:1787832670.673980:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832670.674002:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6af7 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.674020:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832670.674071:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:3305:x1874678300819072:12345-0@lo:103: Request processed in 115us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.674079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832670.674279:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300819072:0@lo:103: 00000100:00100000:2.0:1787832670.675276:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300818944 00000100:00100000:2.0:1787832670.675286:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300818944 00000100:00100000:2.0:1787832670.675390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787832670.675407:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818944:12345-0@lo:502: 00000100:00100000:2.0:1787832670.675789:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300818944:12345-0@lo:502: Request processed in 390us (4093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.675798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787832670.675912:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300818944:0@lo:502: 00000040:00080000:3.0:1787832670.676277:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787832670.676339:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787832670.676372:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787832670.676423:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787832670.676461:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787832670.676498:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787832670.676543:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819200:0@lo:502: 00000100:00100000:3.0:1787832670.676600:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.677485:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566181300 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.679688:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819200 00000100:00100000:1.0:1787832670.679720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819200 00000100:00100000:1.0:1787832670.680069:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787832670.680083:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300819200:12345-0@lo:502: 00000100:00100000:1.0:1787832670.681297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300819200:12345-0@lo:502: Request processed in 1210us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.681310:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787832670.681573:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819200:0@lo:502: 00000040:00080000:3.0:1787832670.682103:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787832670.682124:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787832670.683329:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787832670.683342:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787832670.683351:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832670.683353:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787832670.683359:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787832670.683488:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c3550bbcd28) 00000020:00000080:1.0:1787832670.683517:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787832670.683524:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787832670.683687:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357b0a1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787832670.683697:0:7639:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787832670.684239:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bd9178b14b6b1a 00010000:00010000:1.0:1787832670.691595:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787832670.693031:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787832670.698817:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787832670.699653:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787832670.715276:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787832670.717528:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787832670.722568:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787832670.722588:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832670.722597:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832670.722600:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787832670.722604:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832670.722609:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832670.722610:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787832670.722613:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787832670.722626:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787832670.722969:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832670.722974:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832670.722975:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787832670.722979:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787832670.723408:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787832670.723526:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787832670.723559:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.723575:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.723584:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a1800 from 1 10000000:01000000:1.0:1787832670.723587:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832670.724017:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.724045:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.724060:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.724092:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819328:0@lo:101: 00000100:00100000:1.0:1787832670.724265:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.724549:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.732320:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819328 00000100:00100000:2.0:1787832670.732343:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819328 00000100:00100000:3.0:1787832670.733632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787832670.733649:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+12:7630:x1874678300819328:12345-0@lo:101: 00010000:00010000:3.0:1787832670.733675:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832670.733720:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b21 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.734072:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.734088:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.734099:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215c400, rc 0) 00000100:00100000:3.0:1787832670.734235:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819328:12345-0@lo:101: Request processed in 590us (9971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832670.734244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787832670.734536:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819328:0@lo:101: 00010000:00010000:2.0:1787832670.734560:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.734571:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.734987:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819456:0@lo:501: 00000100:00100000:2.0:1787832670.735047:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.735091:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.735128:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819456 00000100:00100000:2.0:1787832670.735135:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819456 00000100:00100000:2.0:1787832670.735192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787832670.735200:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819456:12345-0@lo:501: 00000100:00100000:2.0:1787832670.735612:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819456:12345-0@lo:501: Request processed in 412us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.735620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787832670.735663:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819456:0@lo:501: 00000100:00100000:2.0:1787832670.735727:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819584:0@lo:503: 00000100:00100000:2.0:1787832670.736051:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.736069:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.736084:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819584 00000100:00100000:2.0:1787832670.736088:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819584 00000100:00100000:2.0:1787832670.736110:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787832670.736117:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819584:12345-0@lo:503: 00000100:00100000:2.0:1787832670.738110:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819584:12345-0@lo:503: Request processed in 1984us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.738125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787832670.738534:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819584:0@lo:503: 00000040:00080000:2.0:1787832670.741043:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787832670.742056:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819712:0@lo:502: 00000100:00100000:2.0:1787832670.742447:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.742543:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832670.744454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819712 00000100:00100000:0.0:1787832670.744468:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819712 00000100:00100000:0.0:1787832670.744585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787832670.744620:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819712:12345-0@lo:502: 00000100:00100000:0.0:1787832670.745307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819712:12345-0@lo:502: Request processed in 695us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.745318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787832670.745592:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819712:0@lo:502: 00000040:00080000:2.0:1787832670.746270:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787832670.746339:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787832670.746507:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819840:0@lo:502: 00000100:00100000:2.0:1787832670.746576:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.746689:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832670.747164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819840 00000100:00100000:0.0:1787832670.747180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819840 00000100:00100000:0.0:1787832670.747226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787832670.747236:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819840:12345-0@lo:502: 00000100:00100000:0.0:1787832670.747589:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819840:12345-0@lo:502: Request processed in 354us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.747600:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787832670.748043:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819840:0@lo:502: 00000040:00080000:1.0:1787832670.748236:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787832670.748257:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787832670.750438:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832670.750457:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832670.750460:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787832670.750469:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357b0a1800 00000020:00000080:0.0:1787832670.750472:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832670.750500:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832670.750503:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832670.750505:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787832670.750508:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787832670.751249:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787832670.751288:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832670.751353:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.751378:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832670.751574:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787832670.751578:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c357b0a1800 10000000:01000000:3.0:1787832670.751582:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c357b0a1800 10000000:01000000:3.0:1787832670.751588:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787832670.751595:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357b0a1800 from 1 10000000:01000000:3.0:1787832670.751598:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787832670.751662:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.751672:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.751793:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832670.751824:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819968:0@lo:101: 00000100:00100000:3.0:1787832670.751925:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.751980:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566181b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.752513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300819968 00000100:00100000:1.0:1787832670.752524:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300819968 00000100:00100000:1.0:1787832670.752589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787832670.752601:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300819968:12345-0@lo:101: 00010000:00010000:1.0:1787832670.752619:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832670.752640:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b2f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.752672:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.752684:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.752693:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c35429d5800, rc 0) 00000100:00100000:1.0:1787832670.752801:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300819968:12345-0@lo:101: Request processed in 202us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.752819:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787832670.753037:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300819968:0@lo:101: 00010000:00010000:1.0:1787832670.753055:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.753066:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832670.753207:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820096:0@lo:501: 00000100:00100000:1.0:1787832670.753241:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.753269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820096 00000100:00100000:1.0:1787832670.753272:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820096 00000100:00100000:1.0:1787832670.753293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787832670.753300:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820096:12345-0@lo:501: 00000100:00100000:1.0:1787832670.753646:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820096:12345-0@lo:501: Request processed in 345us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.753653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787832670.753687:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35660986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.753698:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820096:0@lo:501: 00000100:00100000:1.0:1787832670.753971:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820224:0@lo:503: 00000100:00100000:1.0:1787832670.754010:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.754030:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820224 00000100:00100000:1.0:1787832670.754033:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820224 00000100:00100000:1.0:1787832670.754051:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787832670.754057:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820224:12345-0@lo:503: 00000100:00100000:1.0:1787832670.754321:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820224:12345-0@lo:503: Request processed in 263us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.754332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787832670.754429:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35660986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.754442:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820224:0@lo:503: 00000040:00080000:1.0:1787832670.755333:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787832670.755486:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820352:0@lo:502: 00000100:00100000:1.0:1787832670.755546:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.755586:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35660986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832670.755690:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820352 00000100:00100000:0.0:1787832670.755696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820352 00000100:00100000:0.0:1787832670.755980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787832670.755992:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820352:12345-0@lo:502: 00000100:00100000:0.0:1787832670.757493:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820352:12345-0@lo:502: Request processed in 1494us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.757507:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787832670.758153:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820352:0@lo:502: 00000040:00080000:3.0:1787832670.759142:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787832670.759298:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787832670.759333:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787832670.759447:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787832670.759485:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787832670.759523:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787832670.759550:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787832670.759575:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787832670.759612:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787832670.760115:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787832670.760151:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787832670.760288:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787832670.760328:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787832670.760432:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787832670.760492:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787832670.760553:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787832670.760590:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787832670.761361:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787832670.761485:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787832670.761521:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787832670.761574:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787832670.761611:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787832670.762151:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787832670.762279:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787832670.762315:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787832670.762349:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787832670.762499:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787832670.762540:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787832670.762577:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787832670.763068:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787832670.763115:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787832670.763241:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787832670.763279:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787832670.763343:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787832670.763448:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787832670.763501:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787832670.763537:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787832670.763607:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820480:0@lo:502: 00000100:00100000:3.0:1787832670.764143:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.764331:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566181a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832670.764458:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820480 00000100:00100000:2.0:1787832670.764467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820480 00000100:00100000:2.0:1787832670.764563:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787832670.764575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820480:12345-0@lo:502: 00000100:00100000:2.0:1787832670.764937:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300820480:12345-0@lo:502: Request processed in 364us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.764946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787832670.765048:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300820480:0@lo:502: 00000040:00080000:3.0:1787832670.765172:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787832670.765190:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787832670.766503:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787832670.766525:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c35654799b8) 00000020:00000080:3.0:1787832670.766551:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787832670.767026:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357b0a1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787832670.767032:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c357b0a1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787832670.767035:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357b0a1800 3 00010000:00080000:3.0:1787832670.767079:0:7644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3566169000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1787832670.770608:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787832670.772492:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787832670.772569:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787832670.772587:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bd9178b14b6b44 00000100:00080000:3.0:1787832670.772602:0:7644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832670.772610:0:7644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c3566169000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832670.773036:0:7644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3560ce0000 x1874678300820608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787832670.773071:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787832670.773527:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300820608:0@lo:38: 00000100:00100000:0.0:1787832670.773662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832670.774007:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820608 00000100:00100000:1.0:1787832670.774018:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820608 00000100:00100000:1.0:1787832670.774061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832670.774069:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874678300820608:12345-0@lo:38: 00010000:00080000:1.0:1787832670.774098:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1787832670.774151:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bd9178b14b6b4b 00000004:00100000:1.0:1787832670.774189:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787832670.774238:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832670.774309:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874678300820608:12345-0@lo:38: Request processed in 239us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.774318:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832670.774449:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300820736:0@lo:400: 00000100:00100000:2.0:1787832670.774484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787832670.774506:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3560ce0000 x1874678300820608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832670.774518:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1787832670.774519:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300820864:0@lo:400: 00000100:00080000:0.0:1787832670.774528:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787832670.774536:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787832670.774542:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1787832670.774543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787832670.774544:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3566169000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787832670.774551:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300820608:0@lo:38: 00000100:00100000:2.0:1787832670.774560:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787832670.774565:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300820992:0@lo:400: 00000100:00100000:2.0:1787832670.774591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.774638:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820736 00000100:00100000:0.0:1787832670.774641:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820992 00000100:00100000:2.0:1787832670.774642:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820736 00000100:00100000:0.0:1787832670.774644:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820992 00000100:00100000:2.0:1787832670.774669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300820864 00000100:00100000:2.0:1787832670.774672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300820864 00000100:00100000:2.0:1787832670.774686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787832670.774689:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787832670.774692:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300820736:12345-0@lo:400: 00000100:00100000:0.0:1787832670.774695:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300820992:12345-0@lo:400: 00000100:00100000:2.0:1787832670.774897:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300820736:12345-0@lo:400: Request processed in 203us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.774905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832670.774920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832670.774927:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300820864:12345-0@lo:400: 00000100:00080000:1.0:1787832670.774930:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832670.774935:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832670.775023:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300820864:12345-0@lo:400: Request processed in 97us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832670.775024:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300820992:12345-0@lo:400: Request processed in 328us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832670.775030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832670.775031:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787832670.775056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b588f00 x1874678300820736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832670.775067:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300820736:0@lo:400: 00010000:00080000:2.0:1787832670.775091:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b589a40 x1874678300820992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832670.775097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300820992:0@lo:400: 00010000:00080000:2.0:1787832670.775102:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b5892c0 x1874678300820864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832670.775106:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300820864:0@lo:400: 00000040:00080000:0.0:1787832670.778456:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787832670.778608:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787832670.778644:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787832670.778665:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.778680:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787832670.778845:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787832670.778848:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787832670.778854:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832670.778856:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832670.778857:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832670.778858:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832670.778859:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832670.778861:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832670.778862:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832670.778864:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832670.778866:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832670.778871:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787832670.778873:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787832670.778875:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787832670.778875:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832670.778876:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832670.778877:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832670.778878:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832670.778879:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832670.778880:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832670.778881:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832670.778882:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832670.778883:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832670.778925:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787832670.778948:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf661c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300821120:0@lo:253: 00000100:00100000:0.0:1787832670.779051:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832670.779094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821120 00000100:00100000:0.0:1787832670.779101:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821120 00000100:00100000:0.0:1787832670.779149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787832670.779157:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7630:x1874678300821120:12345-0@lo:253: 20000000:01000000:0.0:1787832670.779202:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787832670.779222:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787832670.779913:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1874678300821248:0@lo:901: 00000100:00100000:2.0:1787832670.779974:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832670.780014:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.780064:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821248 00000100:00100000:1.0:1787832670.780071:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821248 00000100:00100000:1.0:1787832670.780424:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832670.780435:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874678300821248:12345-0@lo:901: 00000100:00100000:0.0:1787832670.780881:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431ebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832670.782558:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874678300821248:12345-0@lo:901: Request processed in 2116us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.782589:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787832670.784059:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c354b5892c0 x1874678300821248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787832686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832670.784082:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1874678300821248:0@lo:901: 00000100:00080000:2.0:1787832670.789414:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1787832670.821997:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787832670.822039:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787832670.822061:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787832670.822068:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787832670.822100:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.822126:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.822138:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.822217:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832670.822237:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 14 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832670.822256:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300821376:0@lo:104: 00000100:00100000:2.0:1787832670.822348:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.822382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821376 00000100:00100000:3.0:1787832670.822394:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821376 00000100:00100000:2.0:1787832670.822402:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787832670.822501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787832670.822513:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300821376:12345-0@lo:104: 00010000:00010000:3.0:1787832670.822529:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.822608:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832670.822614:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:5860:x1874678300821376:12345-0@lo:104: Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832670.822623:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787832670.822631:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874678300821376:0@lo:104: 00010000:00010000:0.0:1787832670.822656:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822722:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832670.822731:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822740:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832670.822745:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822756:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832670.822764:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832670.822770:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787832670.822805:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822813:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832670.822834:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6aa3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832670.822861:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.822863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832670.822865:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832670.822892:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832670.822908:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300821504:0@lo:103: 00000100:00100000:2.0:1787832670.822951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832670.822982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821504 00000100:00100000:3.0:1787832670.822988:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821504 00010000:00010000:3.0:1787832670.823009:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 15 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832670.823046:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787832670.823054:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:3306:x1874678300821504:12345-0@lo:103: 00010000:00010000:3.0:1787832670.823066:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832670.823072:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 15 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823098:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 15 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823114:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215ca00/0x72bd9178b14b6aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6a9c expref: 15 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823130:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823139:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787832670.823154:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008331644s 00010000:00010000:3.0:1787832670.823158:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823178:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823185:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823192:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823198:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74cc00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832670.823202:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823209:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823236:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832670.823246:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832670.823264:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.823272:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832670.823279:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74cc00/0x72bd9178b14b6b52 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832670.823281:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:3306:x1874678300821504:12345-0@lo:103: Request processed in 228us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832670.823288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832670.823319:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300821504:0@lo:103: 00000100:00100000:1.0:1787832670.835970:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:7630:x1874678300821120:12345-0@lo:253: Request processed in 56796us (56901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832670.836009:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787832670.836177:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf661c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:204f2893-acc1-48f1-8f52-36a94d59ea17:7630:1874678300821120:0@lo:253: 10000000:01000000:0.0:1787832670.836200:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787832670.836205:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787832670.836207:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787832670.836208:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832670.836210:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832670.836212:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832670.836214:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832670.836215:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832670.836217:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787832670.836219:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787832670.836221:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832670.836222:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787832670.836243:0:7630:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787832670.845360:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787832670.846503:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787832670.848100:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787832670.850146:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787832670.852273:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832670.854444:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787832670.861065:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787832670.929007:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787832671.164235:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787832671.164246:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787832671.164302:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787832671.164504:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787832671.164525:0:7630:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787832671.164559:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787832671.949351:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832672.029446:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300821632:0@lo:13: 00000100:00100000:2.0:1787832672.029560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832672.029670:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821632 00000100:00100000:2.0:1787832672.029680:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821632 00000100:00100000:2.0:1787832672.029955:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832672.029967:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300821632:12345-0@lo:13: 00002000:00000024:2.0:1787832672.030022:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832672.030076:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300821632:12345-0@lo:13: Request processed in 111us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832672.030084:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787832672.032002:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832672.032086:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b588f00 x1874678300821632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832672.032117:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300821632:0@lo:13: 00010000:00010000:1.0:1787832672.972977:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832673.996527:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832675.023160:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832676.049182:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832676.110777:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300822016:0@lo:400: 00000100:00100000:2.0:1787832676.110886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832676.110984:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832676.110991:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300822144:0@lo:400: 00000100:00100000:2.0:1787832676.111020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832676.111067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822016 00000100:00100000:2.0:1787832676.111088:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822016 00000100:00100000:2.0:1787832676.111168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832676.111180:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300822016:12345-0@lo:400: 00000100:00100000:2.0:1787832676.111243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300822016:12345-0@lo:400: Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832676.111401:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832676.111434:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822144 00000100:00100000:2.0:1787832676.111438:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822144 00000100:00100000:2.0:1787832676.111472:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832676.111479:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300822144:12345-0@lo:400: 00000100:00100000:2.0:1787832676.111516:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300822144:12345-0@lo:400: Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832676.111523:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787832676.111541:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787832676.111546:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787832676.111588:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b718f00 x1874678300822144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832676.111603:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300822144:0@lo:400: 00010000:00080000:2.0:1787832676.111617:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b718b40 x1874678300822016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832676.111625:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300822016:0@lo:400: 00000100:00100000:1.0:1787832676.112601:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300821888:0@lo:400: 00000100:00100000:1.0:1787832676.112669:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832676.112747:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787832676.112756:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300821760:0@lo:400: 00000100:00100000:1.0:1787832676.112793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832676.112824:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300822272:0@lo:400: 00000100:00100000:1.0:1787832676.112854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832676.112886:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821888 00000100:00100000:1.0:1787832676.112892:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821888 00000100:00100000:1.0:1787832676.112936:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822272 00000100:00100000:1.0:1787832676.112939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822272 00000100:00100000:1.0:1787832676.112984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787832676.112993:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300821888:12345-0@lo:400: 00000100:00100000:1.0:1787832676.113044:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300821888:12345-0@lo:400: Request processed in 52us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832676.113051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787832676.113070:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787832676.113089:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300822272:12345-0@lo:400: 00000100:00100000:1.0:1787832676.113133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300822272:12345-0@lo:400: Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832676.113151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787832676.113173:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787832676.113203:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b71ad00 x1874678300822272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832676.113217:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300822272:0@lo:400: 00010000:00080000:1.0:1787832676.113228:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b71b480 x1874678300821888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832676.113236:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300821888:0@lo:400: 00000100:00100000:2.0:1787832676.116833:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300821760 00000100:00100000:2.0:1787832676.116854:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300821760 00000100:00100000:2.0:1787832676.116944:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787832676.116968:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3308:x1874678300821760:12345-0@lo:400: 00000100:00100000:2.0:1787832676.117115:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:3308:x1874678300821760:12345-0@lo:400: Request processed in 161us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832676.117123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787832676.117235:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300821760:0@lo:400: 00010000:00010000:3.0:1787832677.075483:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787832677.133428:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787832677.133454:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357c687800 from 30 10000000:01000000:2.0:1787832677.133462:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787832677.133529:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.133543:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.133557:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832677.133590:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822400:0@lo:101: 00000100:00100000:2.0:1787832677.133692:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832677.133787:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.134282:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300822528:0@lo:13: 00000100:00100000:3.0:1787832677.134329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.134385:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822528 00000100:00100000:3.0:1787832677.134393:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822528 00000100:00100000:3.0:1787832677.134454:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832677.134465:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300822528:12345-0@lo:13: 00002000:00000024:3.0:1787832677.134516:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832677.134573:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300822528:12345-0@lo:13: Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.134581:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787832677.134632:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce0000 x1874678300822528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832677.134653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300822528:0@lo:13: 00000100:00100000:1.0:1787832677.134755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822400 00000100:00100000:1.0:1787832677.134761:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822400 00000100:00100000:1.0:1787832677.134804:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787832677.134812:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300822400:12345-0@lo:101: 00010000:00010000:1.0:1787832677.134823:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832677.134845:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.134878:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.134893:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.134905:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c35429d4600, rc 0) 00000100:00100000:1.0:1787832677.134943:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300822400:12345-0@lo:101: Request processed in 132us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.134962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787832677.135005:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822400:0@lo:101: 00010000:00010000:1.0:1787832677.135026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.135039:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832677.135126:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822656:0@lo:501: 00000100:00100000:1.0:1787832677.135213:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.135235:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674000 going to sleep for 11 seconds 00000100:00100000:1.0:1787832677.135248:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822656 00000100:00100000:1.0:1787832677.135252:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822656 00000100:00100000:1.0:1787832677.135274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787832677.135281:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300822656:12345-0@lo:501: 00000100:00100000:1.0:1787832677.135761:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300822656:12345-0@lo:501: Request processed in 478us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.135770:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787832677.135807:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822656:0@lo:501: 00000100:00100000:1.0:1787832677.135844:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822784:0@lo:503: 00000100:00100000:1.0:1787832677.135888:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.135903:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674000 going to sleep for 11 seconds 00000100:00100000:1.0:1787832677.135916:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822784 00000100:00100000:1.0:1787832677.135920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822784 00000100:00100000:1.0:1787832677.135943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787832677.135950:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300822784:12345-0@lo:503: 00000100:00100000:1.0:1787832677.137619:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300822784:12345-0@lo:503: Request processed in 1658us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.137636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787832677.144660:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300822784:0@lo:503: 00000100:00100000:3.0:1787832677.148173:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7921:1874678300822912:0@lo:502: 00000100:00100000:3.0:1787832677.148327:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.148394:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.148462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300822912 00000100:00100000:0.0:1787832677.148472:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300822912 00000100:00100000:0.0:1787832677.148535:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787832677.148556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7921:x1874678300822912:12345-0@lo:502: 00000100:00100000:0.0:1787832677.149018:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7921:x1874678300822912:12345-0@lo:502: Request processed in 464us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.149027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787832677.149920:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7921:1874678300822912:0@lo:502: 00000100:00100000:3.0:1787832677.150003:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7921:1874678300823040:0@lo:502: 00000100:00100000:3.0:1787832677.150089:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.150140:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.150200:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823040 00000100:00100000:0.0:1787832677.150215:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823040 00000100:00100000:0.0:1787832677.150276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787832677.150287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7921:x1874678300823040:12345-0@lo:502: 00000100:00100000:0.0:1787832677.150523:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:7921:x1874678300823040:12345-0@lo:502: Request processed in 237us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.150531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787832677.150772:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7921:1874678300823040:0@lo:502: 00000040:00080000:2.0:1787832677.150799:0:7921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787832677.151026:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787832677.151069:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787832677.151082:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.151095:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832677.151107:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787832677.151111:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787832677.151114:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787832677.151152:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.151162:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.151173:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832677.151204:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823168:0@lo:101: 00000100:00100000:0.0:1787832677.151249:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.151285:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.151557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823168 00000100:00100000:2.0:1787832677.151565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823168 00000100:00100000:2.0:1787832677.151648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787832677.151657:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300823168:12345-0@lo:101: 00010000:00010000:2.0:1787832677.151669:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832677.151687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b67 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.151737:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.151749:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.151773:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74de00, rc 0) 00000100:00100000:2.0:1787832677.151825:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823168:12345-0@lo:101: Request processed in 168us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.151831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787832677.151897:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823168:0@lo:101: 00010000:00010000:3.0:1787832677.151912:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.151921:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832677.151980:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823296:0@lo:501: 00000100:00100000:3.0:1787832677.152010:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.160954:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.168312:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823296 00000100:00100000:0.0:1787832677.168335:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823296 00000100:00100000:0.0:1787832677.168431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787832677.168443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823296:12345-0@lo:501: 00000100:00100000:0.0:1787832677.168902:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823296:12345-0@lo:501: Request processed in 460us (16890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.168911:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787832677.168998:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823296:0@lo:501: 00000100:00100000:0.0:1787832677.169102:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823424:0@lo:503: 00000100:00100000:0.0:1787832677.170156:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.170212:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.170238:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823424 00000100:00100000:0.0:1787832677.170247:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823424 00000100:00100000:0.0:1787832677.170295:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787832677.170305:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823424:12345-0@lo:503: 00000100:00100000:0.0:1787832677.170891:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823424:12345-0@lo:503: Request processed in 587us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.170901:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787832677.170973:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823424:0@lo:503: 00000100:00100000:2.0:1787832677.180918:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7922:1874678300823552:0@lo:502: 00000100:00100000:2.0:1787832677.181042:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832677.181140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823552 00000100:00100000:2.0:1787832677.181149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823552 00000100:00100000:2.0:1787832677.181207:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787832677.181217:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:7922:x1874678300823552:12345-0@lo:502: 00000100:00100000:2.0:1787832677.181561:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:7922:x1874678300823552:12345-0@lo:502: Request processed in 344us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.181570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787832677.181634:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35432e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.181661:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7922:1874678300823552:0@lo:502: 00000020:01000000:2.0:1787832677.181695:0:7922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832677.181734:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832677.181737:0:7922:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787832677.181744:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787832677.181747:0:7922:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787832677.181766:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7922:1874678300823680:0@lo:502: 00000100:00100000:2.0:1787832677.181802:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832677.181823:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823680 00000100:00100000:2.0:1787832677.181827:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823680 00000100:00100000:2.0:1787832677.181848:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787832677.181855:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:7922:x1874678300823680:12345-0@lo:502: 00000100:00100000:2.0:1787832677.181963:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:7922:x1874678300823680:12345-0@lo:502: Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.181970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787832677.182003:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35432e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.182015:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7922:1874678300823680:0@lo:502: 00000020:01000000:2.0:1787832677.182032:0:7922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832677.182036:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832677.182037:0:7922:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787832677.182041:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787832677.182565:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787832677.182611:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787832677.182623:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.182643:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832677.182667:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787832677.182670:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3543878800 from 30 10000000:01000000:0.0:1787832677.182673:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787832677.182731:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.182741:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.183220:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832677.183244:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823808:0@lo:101: 00000100:00100000:0.0:1787832677.183315:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.183358:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786600 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.185412:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823808 00000100:00100000:2.0:1787832677.185434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823808 00000100:00100000:2.0:1787832677.185547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787832677.185560:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300823808:12345-0@lo:101: 00010000:00010000:2.0:1787832677.187371:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832677.187411:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.187458:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.187472:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.187484:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d200, rc 0) 00000100:00100000:2.0:1787832677.187619:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300823808:12345-0@lo:101: Request processed in 2060us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.187631:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787832677.188828:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823808:0@lo:101: 00010000:00010000:0.0:1787832677.188860:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832677.188874:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832677.189596:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823936:0@lo:501: 00000100:00100000:0.0:1787832677.189675:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.189760:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.189791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300823936 00000100:00100000:0.0:1787832677.189798:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300823936 00000100:00100000:0.0:1787832677.189855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787832677.189867:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300823936:12345-0@lo:501: 00000100:00100000:0.0:1787832677.192880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300823936:12345-0@lo:501: Request processed in 2998us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.192899:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787832677.192986:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300823936:0@lo:501: 00000100:00100000:0.0:1787832677.193070:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824064:0@lo:503: 00000100:00100000:0.0:1787832677.193420:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832677.193464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824064 00000100:00100000:0.0:1787832677.193470:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786600 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.193489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824064 00000100:00100000:2.0:1787832677.193549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787832677.193560:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300824064:12345-0@lo:503: 00000100:00100000:2.0:1787832677.193854:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300824064:12345-0@lo:503: Request processed in 295us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.193862:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787832677.194531:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824064:0@lo:503: 00000100:00100000:0.0:1787832677.195763:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7923:1874678300824192:0@lo:502: 00000100:00100000:0.0:1787832677.195842:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.195894:0:7923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.196153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824192 00000100:00100000:3.0:1787832677.196161:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824192 00000100:00100000:3.0:1787832677.196220:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787832677.196232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:7923:x1874678300824192:12345-0@lo:502: 00000100:00100000:3.0:1787832677.196617:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:7923:x1874678300824192:12345-0@lo:502: Request processed in 386us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.196627:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787832677.198476:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7923:1874678300824192:0@lo:502: 00000100:00100000:0.0:1787832677.198577:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7923:1874678300824320:0@lo:502: 00000100:00100000:0.0:1787832677.198649:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.201712:0:7923:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.221302:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824320 00000100:00100000:2.0:1787832677.221327:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824320 00000100:00100000:2.0:1787832677.221415:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787832677.221429:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:7923:x1874678300824320:12345-0@lo:502: 00000100:00100000:2.0:1787832677.223432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:7923:x1874678300824320:12345-0@lo:502: Request processed in 1993us (24771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.223446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787832677.224432:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf64780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7923:1874678300824320:0@lo:502: 00000040:00080000:0.0:1787832677.224495:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787832677.230591:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787832677.230641:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787832677.230657:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.230671:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832677.230684:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787832677.230688:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3543878800 from 5 10000000:01000000:1.0:1787832677.230692:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787832677.230797:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.230807:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.230821:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832677.230856:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824448:0@lo:101: 00000100:00100000:1.0:1787832677.230956:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.231021:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c6749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.231655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824448 00000100:00100000:3.0:1787832677.231668:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824448 00000100:00100000:3.0:1787832677.231884:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787832677.231897:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300824448:12345-0@lo:101: 00010000:00010000:3.0:1787832677.232004:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832677.232031:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215c200/0x72bd9178b14b6b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b83 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.232079:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215c200/0x72bd9178b14b6b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b83 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.232095:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215c200/0x72bd9178b14b6b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b83 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.232108:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215c200, rc 0) 00000100:00100000:3.0:1787832677.232188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300824448:12345-0@lo:101: Request processed in 294us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.232196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787832677.232289:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824448:0@lo:101: 00010000:00010000:1.0:1787832677.232314:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.232349:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832677.232425:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824576:0@lo:256: 00000100:00100000:1.0:1787832677.232468:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.232504:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c6749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.233199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824576 00000100:00100000:2.0:1787832677.233210:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824576 00000100:00100000:2.0:1787832677.233262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787832677.233272:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300824576:12345-0@lo:256: 20000000:01000000:2.0:1787832677.233294:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787832677.233324:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787832677.233328:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787832677.233465:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300824576:12345-0@lo:256: Request processed in 195us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.233485:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787832677.235107:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824576:0@lo:256: 10000000:01000000:3.0:1787832677.235207:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787832677.235221:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.235234:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832677.235247:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787832677.235251:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787832677.235255:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787832677.235305:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.235313:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.235336:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832677.235359:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824704:0@lo:101: 00000100:00100000:3.0:1787832677.235428:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.235495:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832677.235531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824704 00000100:00100000:1.0:1787832677.235539:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824704 00000100:00100000:1.0:1787832677.235600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787832677.235611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300824704:12345-0@lo:101: 00010000:00010000:1.0:1787832677.235625:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832677.235643:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6b91 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.235671:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.235684:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.235694:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c35429d4400, rc 0) 00000100:00100000:1.0:1787832677.235778:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300824704:12345-0@lo:101: Request processed in 169us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.235785:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787832677.235832:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824704:0@lo:101: 00010000:00010000:1.0:1787832677.235845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832677.235870:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832677.235943:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824832:0@lo:501: 00000100:00100000:1.0:1787832677.235973:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.235994:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674540 going to sleep for 11 seconds 00000100:00100000:1.0:1787832677.236007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824832 00000100:00100000:1.0:1787832677.236011:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824832 00000100:00100000:1.0:1787832677.236031:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787832677.236037:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300824832:12345-0@lo:501: 00000100:00100000:1.0:1787832677.236630:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300824832:12345-0@lo:501: Request processed in 590us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.236639:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787832677.236667:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824832:0@lo:501: 00000100:00100000:3.0:1787832677.236739:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824960:0@lo:503: 00000100:00100000:3.0:1787832677.237008:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.237035:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c34418940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832677.238470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300824960 00000100:00100000:1.0:1787832677.238486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300824960 00000100:00100000:1.0:1787832677.238567:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787832677.238579:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300824960:12345-0@lo:503: 00000100:00100000:3.0:1787832677.239849:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300824960:0@lo:503: 00000100:00100000:1.0:1787832677.241877:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300824960:12345-0@lo:503: Request processed in 3286us (4855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.241898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787832677.250242:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7924:1874678300825088:0@lo:502: 00000100:00100000:3.0:1787832677.250386:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.251067:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.252857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825088 00000100:00100000:0.0:1787832677.252878:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825088 00000100:00100000:0.0:1787832677.253153:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787832677.253170:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:7924:x1874678300825088:12345-0@lo:502: 00000100:00100000:0.0:1787832677.254319:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:7924:x1874678300825088:12345-0@lo:502: Request processed in 1146us (3925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.254340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787832677.254384:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7924:1874678300825088:0@lo:502: 00000020:01000000:2.0:1787832677.254438:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787832677.254451:0:7924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787832677.254460:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832677.254472:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787832677.254481:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787832677.254485:0:7924:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:2.0:1787832677.254517:0:7924:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787832677.254521:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787832677.254558:0:7924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c3442963370) 00000020:00000080:2.0:1787832677.254590:0:7924:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787832677.254596:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787832677.254737:0:7924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787832677.254748:0:7924:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787832677.254758:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b6ba6 00010000:00080000:2.0:1787832677.254806:0:7924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3443124800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787832677.255183:0:7924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787832677.255616:0:7924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787832677.255635:0:7924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787832677.256401:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832677.257213:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832677.257276:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787832677.257349:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787832677.258431:0:7925:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832677.258438:0:7925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787832677.261864:0:7924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787832677.262011:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787832677.262086:0:7924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787832677.262124:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b6bad 00000100:00080000:3.0:1787832677.262141:0:7924:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832677.262150:0:7924:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3443124800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832677.262212:0:7924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3560ce3480 x1874678300825216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787832677.262284:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300825216:0@lo:8: 00000100:00100000:0.0:1787832677.262396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787832677.262487:0:7924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787832677.262520:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825216 00000100:00100000:2.0:1787832677.262530:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825216 00000100:00100000:2.0:1787832677.262570:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832677.262579:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874678300825216:12345-0@lo:8: 00000100:00100000:3.0:1787832677.262601:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300825344:0@lo:400: 00010000:00080000:2.0:1787832677.262610:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1787832677.262642:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b6bb4 00002000:00100000:2.0:1787832677.262661:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c3443122000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787832677.262666:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787832677.262671:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787832677.262857:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787832677.262885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.262982:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832677.262992:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300825472:0@lo:400: 00000100:00100000:3.0:1787832677.263018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1787832677.263045:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1787832677.263064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300825600:0@lo:400: 00000100:00100000:3.0:1787832677.263094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787832677.263095:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3443120000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787832677.263137:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825344 00000100:00100000:3.0:1787832677.263142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825344 00000100:00100000:3.0:1787832677.263173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825472 00000100:00100000:3.0:1787832677.263176:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825472 00000100:00100000:3.0:1787832677.263190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825600 00000100:00100000:3.0:1787832677.263194:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825600 00000100:00100000:3.0:1787832677.263208:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787832677.263216:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300825344:12345-0@lo:400: 00000100:00100000:3.0:1787832677.263271:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300825344:12345-0@lo:400: Request processed in 55us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.263284:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787832677.263302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787832677.263308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300825472:12345-0@lo:400: 00000100:00100000:3.0:1787832677.263336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300825472:12345-0@lo:400: Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.263342:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787832677.263353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787832677.263359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300825600:12345-0@lo:400: 00000100:00100000:3.0:1787832677.263391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300825600:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.263397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787832677.263450:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce21c0 x1874678300825600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832677.263468:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300825600:0@lo:400: 00010000:00080000:3.0:1787832677.263512:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3840 x1874678300825472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832677.263521:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300825472:0@lo:400: 00010000:00080000:3.0:1787832677.263531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3c00 x1874678300825344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832677.263537:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300825344:0@lo:400: 00000020:01000000:3.0:1787832677.263598:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832677.263606:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832677.263609:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787832677.263612:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832677.263617:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832677.263618:0:7924:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787832677.263621:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787832677.263623:0:7924:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787832677.263664:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7924:1874678300825728:0@lo:502: 00000100:00100000:3.0:1787832677.263742:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.269385:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825728 00000100:00100000:1.0:1787832677.269405:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825728 00000100:00100000:1.0:1787832677.269481:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787832677.269492:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:7924:x1874678300825728:12345-0@lo:502: 00000100:00100000:1.0:1787832677.269873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:7924:x1874678300825728:12345-0@lo:502: Request processed in 381us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.269892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787832677.270298:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.270334:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:7924:1874678300825728:0@lo:502: 00000020:01000000:3.0:1787832677.270377:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832677.270386:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832677.270389:0:7924:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787832677.270394:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787832677.270480:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787832677.270508:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787832677.270528:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270540:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832677.270552:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787832677.270555:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3543794d28 from 1 10000000:01000000:3.0:1787832677.270558:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787832677.270599:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270607:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270618:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832677.270641:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300825856:0@lo:101: 00000100:00100000:3.0:1787832677.270686:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.270737:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.270755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825856 00000100:00100000:3.0:1787832677.270759:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825856 00000100:00100000:3.0:1787832677.270790:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832677.270798:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300825856:12345-0@lo:101: 00010000:00010000:3.0:1787832677.270809:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832677.270825:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6bbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270853:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270871:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270881:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215d400, rc 0) 00000100:00100000:3.0:1787832677.270910:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300825856:12345-0@lo:101: Request processed in 114us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832677.270916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832677.270945:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300825856:0@lo:101: 00010000:00010000:3.0:1787832677.270957:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832677.270966:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832677.271015:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300825984:0@lo:501: 00000100:00100000:3.0:1787832677.271039:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832677.275580:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874678300825216:12345-0@lo:8: Request processed in 12982us (13165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.275607:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832677.278941:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.279014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300825984 00000100:00100000:3.0:1787832677.279032:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300825984 00000100:00100000:3.0:1787832677.279120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787832677.279134:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300825984:12345-0@lo:501: 00000100:00100000:3.0:1787832677.280022:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300825984:12345-0@lo:501: Request processed in 887us (8978us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832677.280034:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1787832677.280214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3480 x1874678300825216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787832687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832677.280230:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832677.280242:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787832677.280252:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787832677.280260:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787832677.280264:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3443124800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787832677.280290:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787832677.280300:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300825216:0@lo:8: 00000100:00100000:2.0:1787832677.280480:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300825984:0@lo:501: 10000000:01000000:2.0:1787832677.280522:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787832677.280535:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832677.280547:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832677.282935:0:7925:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787832677.283212:0:7925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200311508948ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787832677.387946:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787832677.387994:0:7926:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787832677.388030:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826240:0@lo:7: 00000100:00100000:3.0:1787832677.388323:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.388395:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.388414:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300826112:0@lo:13: 00000100:00100000:3.0:1787832677.388445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.388492:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826240 00000100:00100000:3.0:1787832677.388501:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826240 00000100:00080000:1.0:1787832677.388539:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832677.388574:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832677.388584:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7926:x1874678300826240:12345-0@lo:7: 00000100:00100000:2.0:1787832677.392697:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826112 00000100:00100000:2.0:1787832677.392731:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826112 00000100:00100000:2.0:1787832677.392820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787832677.392831:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300826112:12345-0@lo:13: 00002000:00000024:2.0:1787832677.392874:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787832677.393009:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300826112:12345-0@lo:13: Request processed in 179us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.393016:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787832677.393066:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3840 x1874678300826112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832677.393093:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300826112:0@lo:13: 00002000:00080000:2.0:1787832677.398404:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787832677.398416:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787832677.398550:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7926:x1874678300826240:12345-0@lo:7: Request processed in 9960us (10221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832677.398563:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787832677.398621:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce21c0 x1874678300826240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787832693 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832677.398728:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826240:0@lo:7: 00000004:00080000:1.0:1787832677.398811:0:7926:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787832677.398868:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826368:0@lo:5: 00000100:00100000:1.0:1787832677.398911:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832677.398954:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832677.399071:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826368 00000100:00100000:2.0:1787832677.399079:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826368 00000100:00100000:1.0:1787832677.400109:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787832677.400125:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7926:x1874678300826368:12345-0@lo:5: 00002000:00080000:1.0:1787832677.400161:0:6696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787832677.400165:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787832677.400569:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7926:x1874678300826368:12345-0@lo:5: Request processed in 450us (1657us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787832677.400577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787832677.402660:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560c81a40 x1874678300826368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787832693 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832677.402686:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826368:0@lo:5: 00000004:00080000:0.0:1787832677.402725:0:7926:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787832677.402796:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf65680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826496:0@lo:700: 00000100:00100000:0.0:1787832677.402867:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.402923:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832677.403372:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826496 00000100:00100000:3.0:1787832677.403381:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826496 00000100:00100000:3.0:1787832677.403448:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832677.403459:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7926:x1874678300826496:12345-0@lo:700: 00000100:00100000:3.0:1787832677.403505:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874678300826624:0@lo:700: 00000100:00100000:3.0:1787832677.403544:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832677.403574:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894780 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.403624:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826624 00000100:00100000:0.0:1787832677.403684:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826624 00000100:00100000:0.0:1787832677.403808:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832677.403818:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874678300826624:12345-0@lo:700: 40000000:02000000:1.0:1787832677.466374:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00010000:00080000:0.0:1787832677.470921:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3480 x1874678300826624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787832693 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832677.470943:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1874678300826624:0@lo:700: 40000000:02000000:0.0:1787832677.470960:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1787832677.472353:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1874678300826624:12345-0@lo:700: Request processed in 68529us (68800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832677.472368:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1787832677.593697:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787832677.593763:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787832677.595066:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7926:x1874678300826496:12345-0@lo:700: Request processed in 191587us (192176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832677.595093:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787832677.595173:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c355cf65680 x1874678300826496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787832693 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832677.595188:0:7926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787832677.595212:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf65680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826496:0@lo:700: 00000004:02000040:0.0:1787832677.659886:0:7926:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787832677.665580:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf65680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826752:0@lo:5: 00000100:00100000:0.0:1787832677.665689:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832677.665807:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354649e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787832677.665845:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826752 00000100:00100000:0.0:1787832677.665854:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826752 00000100:00100000:0.0:1787832677.665922:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832677.665932:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7926:x1874678300826752:12345-0@lo:5: 00002000:00080000:0.0:1787832677.676299:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787832677.676340:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787832677.694079:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7926:x1874678300826752:12345-0@lo:5: Request processed in 28132us (28375us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787832677.694099:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787832677.700218:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c355cf65680 x1874678300826752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787832693 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832677.700248:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf65680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1874678300826752:0@lo:5: 00000004:00080000:2.0:1787832677.700294:0:7926:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787832678.092266:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832679.116066:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832679.675048:0:7995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787832680.162654:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832681.164210:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832682.190326:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832682.252352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832682.252389:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300826880:0@lo:13: 00000100:00100000:3.0:1787832682.252489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832682.252584:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300826880 00000100:00100000:2.0:1787832682.252595:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300826880 00000100:00100000:2.0:1787832682.252676:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787832682.252686:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300826880:12345-0@lo:13: 00002000:00000024:2.0:1787832682.252759:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832682.252822:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300826880:12345-0@lo:13: Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832682.252830:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787832682.252881:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560ce3840 x1874678300826880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832682.252900:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300826880:0@lo:13: 00000100:00080000:3.0:1787832682.254130:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832682.764724:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832682.764766:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300827008:0@lo:13: 00000100:00100000:2.0:1787832682.764880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832682.765192:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300827136:0@lo:400: 00000100:00100000:3.0:1787832682.765252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832682.765283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832682.765297:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300827264:0@lo:400: 00000100:00100000:3.0:1787832682.765329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832682.765356:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300827520:0@lo:400: 00000100:00100000:3.0:1787832682.765379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832682.765396:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832682.765401:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300827392:0@lo:400: 00000100:00100000:3.0:1787832682.765423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832682.765452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827264 00000100:00100000:3.0:1787832682.765461:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827264 00000100:00100000:3.0:1787832682.765511:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827520 00000100:00100000:3.0:1787832682.765515:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827520 00000100:00100000:3.0:1787832682.765541:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827392 00000100:00100000:3.0:1787832682.765544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827392 00000100:00100000:3.0:1787832682.765562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787832682.765573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300827264:12345-0@lo:400: 00000100:00100000:3.0:1787832682.765635:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300827264:12345-0@lo:400: Request processed in 62us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832682.765642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787832682.765662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787832682.765668:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300827520:12345-0@lo:400: 00000100:00100000:3.0:1787832682.765697:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300827520:12345-0@lo:400: Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832682.765726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787832682.765738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787832682.765744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300827392:12345-0@lo:400: 00000100:00100000:3.0:1787832682.765772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300827392:12345-0@lo:400: Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832682.765787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787832682.765805:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787832682.765838:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ac780 x1874678300827264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832682.765853:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300827264:0@lo:400: 00010000:00080000:3.0:1787832682.765881:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ad680 x1874678300827392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832682.765889:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300827392:0@lo:400: 00010000:00080000:3.0:1787832682.765897:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ae940 x1874678300827520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832682.765905:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300827520:0@lo:400: 00000100:00100000:2.0:1787832682.766401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827136 00000100:00100000:2.0:1787832682.766407:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827136 00000100:00100000:2.0:1787832682.766441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787832682.766448:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300827136:12345-0@lo:400: 00000100:00100000:2.0:1787832682.766513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300827136:12345-0@lo:400: Request processed in 66us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832682.766520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787832682.766561:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300827136:0@lo:400: 00000100:00100000:1.0:1787832682.768592:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827008 00000100:00100000:1.0:1787832682.768609:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827008 00000100:00100000:1.0:1787832682.768684:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787832682.768694:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300827008:12345-0@lo:13: 00000100:00080000:3.0:1787832682.768752:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787832682.768778:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832682.768880:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300827008:12345-0@lo:13: Request processed in 187us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832682.768888:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787832682.768934:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35464fd680 x1874678300827008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832682.768989:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300827008:0@lo:13: 00000001:00080000:2.0:1787832682.888679:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787832683.216379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832684.239945:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832685.259832:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832686.293042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832687.308803:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832687.373898:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300827648:0@lo:13: 00000100:00100000:2.0:1787832687.374005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832687.377268:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827648 00000100:00100000:2.0:1787832687.377285:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827648 00000100:00100000:2.0:1787832687.377380:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787832687.377390:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300827648:12345-0@lo:13: 00002000:00000024:2.0:1787832687.379045:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832687.379688:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300827648:12345-0@lo:13: Request processed in 2294us (5677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832687.379793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787832687.379829:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787832687.382311:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b718f00 x1874678300827648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832687.382343:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300827648:0@lo:13: 00000100:00100000:3.0:1787832687.615306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.616658:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282977408 00000100:00100000:1.0:1787832687.616672:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282977408 00000100:00100000:1.0:1787832687.617060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:1.0:1787832687.617079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1874678282977408:12345-192.168.201.34@tcp:250: 00010000:00080000:1.0:1787832687.617117:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5fcfcf5f-6ec9-48b8-bf3c-549401e30d94@192.168.201.34@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1787832687.617157:0:5837:0:(genops.c:1385:class_connect()) connect: client 5fcfcf5f-6ec9-48b8-bf3c-549401e30d94, cookie 0x72bd9178b14b6bc9 00000100:00080000:1.0:1787832687.617334:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8c357bb22800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832687.617426:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+5:2351:x1874678282977408:12345-192.168.201.34@tcp:250: Request processed in 356us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.617435:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:3.0:1787832687.650387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832687.650538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282977536 00000100:00100000:0.0:1787832687.650551:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282977536 00000100:00100000:0.0:1787832687.650614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1787832687.650626:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+5:5583:x1874678282977536:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787832687.650648:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832687.650670:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706601 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.650745:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.650758:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.650768:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00100000:0.0:1787832687.650841:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+6:5583:x1874678282977536:12345-192.168.201.34@tcp:101: Request processed in 217us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832687.650849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:0.0:1787832687.653649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832687.659496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282977664 00000100:00100000:2.0:1787832687.659519:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282977664 00000100:00100000:3.0:1787832687.659718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787832687.659730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+6:5583:x1874678282977664:12345-192.168.201.34@tcp:501: 00000100:00100000:3.0:1787832687.660263:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+6:5583:x1874678282977664:12345-192.168.201.34@tcp:501: Request processed in 532us (6622us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832687.660274:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:3.0:1787832687.679768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.679827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282977792 00000100:00100000:3.0:1787832687.679840:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282977792 00000100:00100000:3.0:1787832687.679908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:3.0:1787832687.679920:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+6:5583:x1874678282977792:12345-192.168.201.34@tcp:101: 00010000:00010000:3.0:1787832687.679944:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832687.679967:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706608 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832687.680009:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832687.680023:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832687.680033:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215da00, rc 0) 00000100:00100000:3.0:1787832687.680108:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+7:5583:x1874678282977792:12345-192.168.201.34@tcp:101: Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.680117:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:1.0:1787832687.689615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.689663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282977920 00000100:00100000:1.0:1787832687.689676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282977920 00000100:00100000:1.0:1787832687.689777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:1.0:1787832687.689789:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+7:5583:x1874678282977920:12345-192.168.201.34@tcp:501: 00000100:00100000:1.0:1787832687.690232:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5583:x1874678282977920:12345-192.168.201.34@tcp:501: Request processed in 443us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.690252:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787832687.692393:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.692950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978048 00000100:00100000:1.0:1787832687.692960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978048 00000100:00100000:1.0:1787832687.693031:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:1.0:1787832687.693043:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5583:x1874678282978048:12345-192.168.201.34@tcp:503: 00000100:00100000:1.0:1787832687.693496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5583:x1874678282978048:12345-192.168.201.34@tcp:503: Request processed in 453us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.693506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:1.0:1787832687.696826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.698134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978176 00000100:00100000:3.0:1787832687.698148:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978176 00000100:00100000:3.0:1787832687.698259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1787832687.698272:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5603:x1874678282978176:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787832687.698744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5603:x1874678282978176:12345-192.168.201.34@tcp:502: Request processed in 473us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.698754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:0.0:1787832687.722266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.722367:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978304 00000100:00100000:1.0:1787832687.722381:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978304 00000100:00100000:1.0:1787832687.722453:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:1.0:1787832687.722465:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5603:x1874678282978304:12345-192.168.201.34@tcp:502: 00000100:00100000:1.0:1787832687.722845:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5603:x1874678282978304:12345-192.168.201.34@tcp:502: Request processed in 381us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.722854:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:3.0:1787832687.733019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.733318:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978432 00000100:00100000:1.0:1787832687.733330:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978432 00000100:00100000:1.0:1787832687.733397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:1.0:1787832687.733409:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5583:x1874678282978432:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1787832687.733432:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832687.733454:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad40200/0x72bd9178b14b6bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706632 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832687.733491:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40200/0x72bd9178b14b6bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706632 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832687.733529:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad40200/0x72bd9178b14b6bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706632 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832687.733540:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40200, rc 0) 00000100:00100000:1.0:1787832687.733619:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5583:x1874678282978432:12345-192.168.201.34@tcp:101: Request processed in 212us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.733628:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787832687.744007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.744286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978560 00000100:00100000:1.0:1787832687.744299:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978560 00000100:00100000:1.0:1787832687.744369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:1.0:1787832687.744381:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5583:x1874678282978560:12345-192.168.201.34@tcp:256: 20000000:01000000:1.0:1787832687.744417:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787832687.744439:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787832687.744443:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787832687.744446:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787832687.744449:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787832687.758365:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5583:x1874678282978560:12345-192.168.201.34@tcp:256: Request processed in 13968us (14357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832687.758385:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:3.0:1787832687.761375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832687.761476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978688 00000100:00100000:0.0:1787832687.761490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978688 00000100:00100000:0.0:1787832687.761559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:0.0:1787832687.761570:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5583:x1874678282978688:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787832687.761592:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832687.761625:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706639 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.761665:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.761678:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832687.761725:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832687.761789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5583:x1874678282978688:12345-192.168.201.34@tcp:101: Request processed in 221us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832687.761797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:2.0:1787832687.763447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.763528:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978816 00000100:00100000:3.0:1787832687.763537:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978816 00000100:00100000:3.0:1787832687.763584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:3.0:1787832687.763593:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5583:x1874678282978816:12345-192.168.201.34@tcp:501: 00000100:00100000:3.0:1787832687.764212:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5583:x1874678282978816:12345-192.168.201.34@tcp:501: Request processed in 617us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.764223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:2.0:1787832687.766000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.766175:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282978944 00000100:00100000:3.0:1787832687.766186:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282978944 00000100:00100000:3.0:1787832687.766242:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1787832687.766252:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5583:x1874678282978944:12345-192.168.201.34@tcp:503: 00000100:00100000:3.0:1787832687.766673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5583:x1874678282978944:12345-192.168.201.34@tcp:503: Request processed in 421us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.766682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:2.0:1787832687.770168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.770292:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979072 00000100:00100000:3.0:1787832687.770302:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979072 00000100:00100000:3.0:1787832687.770357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:3.0:1787832687.770368:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5608:x1874678282979072:12345-192.168.201.34@tcp:502: 00000100:00100000:3.0:1787832687.770728:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5608:x1874678282979072:12345-192.168.201.34@tcp:502: Request processed in 360us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.770737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1787832687.773423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832687.773565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979200 00000100:00100000:1.0:1787832687.773576:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979200 00000100:00100000:1.0:1787832687.773637:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:1.0:1787832687.773648:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5608:x1874678282979200:12345-192.168.201.34@tcp:502: 00000100:00100000:1.0:1787832687.773986:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5608:x1874678282979200:12345-192.168.201.34@tcp:502: Request processed in 339us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.773996:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:2.0:1787832687.777486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832687.777651:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979328 00000100:00100000:3.0:1787832687.777663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979328 00000100:00100000:3.0:1787832687.777756:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787832687.777766:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1874678282979328:12345-192.168.201.34@tcp:38: 00010000:00080000:3.0:1787832687.777800:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1787832687.777885:0:5844:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b6bec 00000004:00100000:3.0:1787832687.777925:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787832687.777940:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787832687.859761:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8c3566177000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787832687.859865:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678282979328:12345-192.168.201.34@tcp:38: Request processed in 82097us (82391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832687.859890:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787832687.883964:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300828160:0@lo:400: 00000100:00100000:1.0:1787832687.884101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.884180:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787832687.884187:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300827776:0@lo:400: 00000100:00100000:1.0:1787832687.884219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.884239:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300828288:0@lo:400: 00000100:00100000:1.0:1787832687.884260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.884282:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300828032:0@lo:400: 00000100:00100000:1.0:1787832687.884304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.884319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832687.884323:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300827904:0@lo:400: 00000100:00100000:1.0:1787832687.884342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.884369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827776 00000100:00100000:1.0:1787832687.884376:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827776 00000100:00100000:1.0:1787832687.884437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787832687.884446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300827776:12345-0@lo:400: 00000100:00100000:1.0:1787832687.884501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300827776:12345-0@lo:400: Request processed in 56us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.884510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787832687.884548:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828288 00000100:00100000:1.0:1787832687.884551:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828288 00000100:00100000:1.0:1787832687.884586:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832687.884591:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300828288:12345-0@lo:400: 00000100:00100000:1.0:1787832687.884623:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300828288:12345-0@lo:400: Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.884630:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832687.884684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300827776:0@lo:400: 00010000:00080000:1.0:1787832687.884734:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560c821c0 x1874678300828288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832687.884761:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787832687.884785:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300828288:0@lo:400: 00000100:00100000:1.0:1787832687.884814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828160 00000100:00100000:1.0:1787832687.884818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828160 00000100:00100000:1.0:1787832687.884843:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828032 00000100:00100000:1.0:1787832687.884846:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828032 00000100:00100000:1.0:1787832687.884858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300827904 00000100:00100000:1.0:1787832687.884861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300827904 00000100:00100000:1.0:1787832687.884889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832687.884896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300828160:12345-0@lo:400: 00000100:00100000:1.0:1787832687.884936:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300828160:12345-0@lo:400: Request processed in 41us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.884942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832687.884953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787832687.884958:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300828032:12345-0@lo:400: 00000100:00100000:1.0:1787832687.884984:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300828032:12345-0@lo:400: Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.884990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787832687.884998:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832687.885003:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300827904:12345-0@lo:400: 00000100:00100000:1.0:1787832687.885024:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300827904:12345-0@lo:400: Request processed in 22us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.885030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787832687.885052:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560c81a40 x1874678300827904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832687.885062:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300827904:0@lo:400: 00010000:00080000:1.0:1787832687.885079:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560c81e00 x1874678300828032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832687.885087:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300828032:0@lo:400: 00010000:00080000:1.0:1787832687.885108:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560c83480 x1874678300828160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832687.885117:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300828160:0@lo:400: 00000100:00080000:2.0:1787832687.894621:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787832687.894637:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832687.895025:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832687.895056:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566094780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300828416:0@lo:13: 00000100:00100000:1.0:1787832687.895158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832687.895214:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828416 00000100:00100000:1.0:1787832687.895223:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828416 00000100:00100000:1.0:1787832687.895275:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832687.895284:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300828416:12345-0@lo:13: 00002000:00000024:1.0:1787832687.895326:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832687.895371:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300828416:12345-0@lo:13: Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832687.895379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787832687.895436:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3566094780 x1874678300828416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832687.895456:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566094780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300828416:0@lo:13: 00010000:00010000:2.0:1787832688.335769:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832688.868645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832688.868685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832688.868747:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979584 00000100:00100000:0.0:1787832688.868760:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979584 00000100:00100000:0.0:1787832688.868831:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979456 00000100:00100000:0.0:1787832688.868835:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979456 00000100:00100000:0.0:1787832688.868869:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832688.868881:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:5583:x1874678282979584:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1787832688.869219:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787832688.869358:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:5583:x1874678282979584:12345-192.168.201.34@tcp:41: Request processed in 478us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832688.869379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832688.869401:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787832688.869408:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:0:x1874678282979456:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1787832688.869422:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787832688.869448:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:0:x1874678282979456:12345-192.168.201.34@tcp:41: Request processed in 41us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832688.869454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00080000:0.0:1787832688.869477:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832688.889487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832688.889612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979712 00000100:00100000:0.0:1787832688.889625:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979712 00000100:00100000:0.0:1787832688.889744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787832688.889758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5583:x1874678282979712:12345-192.168.201.34@tcp:40: 00000100:00100000:0.0:1787832688.889969:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5583:x1874678282979712:12345-192.168.201.34@tcp:40: Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832688.889978:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1787832688.899846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832688.899932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832688.899966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832688.899992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832688.900061:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979840 00000100:00100000:1.0:1787832688.900074:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979840 00000100:00100000:1.0:1787832688.900117:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282979968 00000100:00100000:1.0:1787832688.900121:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282979968 00000100:00100000:1.0:1787832688.900139:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787832688.900148:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874678282979840:12345-192.168.201.34@tcp:8: 00010000:00080000:1.0:1787832688.900188:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1787832688.900230:0:6696:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b6bf3 00002000:00100000:1.0:1787832688.900246:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436/ffff8c357bb23800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787832688.900260:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787832688.900682:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787832688.900767:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357bb25000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832688.900865:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678282979840:12345-192.168.201.34@tcp:8: Request processed in 715us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832688.900874:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787832688.900897:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787832688.900901:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874678282979968:12345-192.168.201.34@tcp:8: 00010000:00080000:1.0:1787832688.900918:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1787832688.900937:0:6696:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b6bfa 00002000:00100000:1.0:1787832688.900943:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436/ffff8c357bb24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787832688.900951:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787832688.901195:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787832688.901215:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357bb27800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832688.901243:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678282979968:12345-192.168.201.34@tcp:8: Request processed in 340us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832688.901266:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787832688.902043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980224 00000100:00100000:3.0:1787832688.902064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980224 00000100:00100000:3.0:1787832688.902118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:3.0:1787832688.902128:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678282980224:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787832688.902176:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678282980224:12345-192.168.201.34@tcp:400: Request processed in 50us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832688.902183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:2.0:1787832688.903061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980096 00000100:00100000:2.0:1787832688.903078:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980096 00000100:00100000:2.0:1787832688.903125:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787832688.903134:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5583:x1874678282980096:12345-192.168.201.34@tcp:33: 00000004:00080000:3.0:1787832688.937126:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33910us 00000004:00200000:1.0:1787832688.971366:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787832688.971581:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5583:x1874678282980096:12345-192.168.201.34@tcp:33: Request processed in 68439us (71743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832688.971599:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000001:00100000:0.0:1787832688.996771:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000100:00100000:1.0:1787832689.267997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832689.268139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980352 00000100:00100000:0.0:1787832689.268155:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980352 00000100:00100000:0.0:1787832689.268246:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787832689.268259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5625:x1874678282980352:12345-192.168.201.34@tcp:101: 00010000:00010000:0.0:1787832689.268287:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832689.268324:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706663 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268425:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268473:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268492:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832689.268816:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787832689.268821:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832689.268912:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268949:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706663 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268968:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706663 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832689.268978:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f100) 00010000:00010000:0.0:1787832689.268981:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832689.268985:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:0.0:1787832689.269073:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:5625:x1874678282980352:12345-192.168.201.34@tcp:101: Request processed in 817us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832689.269081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:3.0:1787832689.358575:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832690.381272:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832691.405439:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832691.964636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832691.964847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980480 00000100:00100000:0.0:1787832691.964870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980480 00000100:00100000:0.0:1787832691.964994:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787832691.965008:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:5677:x1874678282980480:12345-192.168.201.34@tcp:41: 00000004:00000024:0.0:1787832691.965072:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787832691.965188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:5677:x1874678282980480:12345-192.168.201.34@tcp:41: Request processed in 184us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832691.965198:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:2.0:1787832691.965295:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832691.971903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832691.971991:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980608 00000100:00100000:1.0:1787832691.972006:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980608 00000100:00100000:1.0:1787832691.972112:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832691.972124:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:5677:x1874678282980608:12345-192.168.201.34@tcp:13: 00002000:00000024:1.0:1787832691.972180:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832691.972273:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:5677:x1874678282980608:12345-192.168.201.34@tcp:13: Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832691.972281:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:2.0:1787832691.972357:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832691.991349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832691.991652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980736 00000100:00100000:1.0:1787832691.991665:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980736 00000100:00100000:1.0:1787832691.991769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787832691.991780:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5677:x1874678282980736:12345-192.168.201.34@tcp:13: 00002000:00000024:1.0:1787832691.991842:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832691.991938:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:5677:x1874678282980736:12345-192.168.201.34@tcp:13: Request processed in 159us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832691.991947:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:2.0:1787832691.992228:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787832692.428247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832692.496999:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300828544:0@lo:13: 00000100:00100000:1.0:1787832692.497117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832692.497646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828544 00000100:00100000:0.0:1787832692.497660:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828544 00000100:00100000:0.0:1787832692.497780:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832692.497801:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300828544:12345-0@lo:13: 00002000:00000024:0.0:1787832692.497830:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832692.497901:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300828544:12345-0@lo:13: Request processed in 111us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832692.497909:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787832692.497983:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787832692.498137:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b71ad00 x1874678300828544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832692.498160:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300828544:0@lo:13: 00000100:00100000:2.0:1787832693.014086:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300828800:0@lo:400: 00000100:00100000:2.0:1787832693.014198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014277:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300829312:0@lo:400: 00000100:00100000:2.0:1787832693.014307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014344:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787832693.014351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300828672:0@lo:400: 00000100:00100000:2.0:1787832693.014383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014404:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35591930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300829184:0@lo:400: 00000100:00100000:2.0:1787832693.014425:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014455:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300829056:0@lo:400: 00000100:00100000:2.0:1787832693.014482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014502:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832693.014507:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300828928:0@lo:400: 00000100:00100000:2.0:1787832693.014528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832693.014558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828800 00000100:00100000:2.0:1787832693.014567:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828800 00000100:00100000:2.0:1787832693.014612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829184 00000100:00100000:2.0:1787832693.014616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829184 00000100:00100000:2.0:1787832693.014642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828928 00000100:00100000:2.0:1787832693.014644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828928 00000100:00100000:2.0:1787832693.014673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787832693.014681:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300828800:12345-0@lo:400: 00000100:00100000:2.0:1787832693.014765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300828800:12345-0@lo:400: Request processed in 83us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832693.014773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787832693.015789:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300829440:0@lo:13: 00000100:00100000:3.0:1787832693.015853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832693.016299:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829440 00000100:00100000:3.0:1787832693.016305:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829440 00000100:00100000:3.0:1787832693.016355:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787832693.016364:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300829440:12345-0@lo:13: 00002000:00000024:3.0:1787832693.016407:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832693.016472:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300829440:12345-0@lo:13: Request processed in 109us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.016481:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787832693.016627:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ae580 x1874678300829440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832693.016649:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300829440:0@lo:13: 00000100:00100000:3.0:1787832693.017080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832693.017093:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300829184:12345-0@lo:400: 00000100:00100000:3.0:1787832693.017148:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300829184:12345-0@lo:400: Request processed in 58us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.017154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832693.017172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787832693.017179:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300828928:12345-0@lo:400: 00000100:00100000:3.0:1787832693.017215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300828928:12345-0@lo:400: Request processed in 36us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.017221:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787832693.017240:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829312 00000100:00100000:3.0:1787832693.017246:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829312 00000100:00100000:3.0:1787832693.017271:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829056 00000100:00100000:3.0:1787832693.017274:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829056 00000100:00100000:3.0:1787832693.017288:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832693.017294:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300829312:12345-0@lo:400: 00000100:00100000:3.0:1787832693.017325:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300829312:12345-0@lo:400: Request processed in 31us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.017330:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832693.017354:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787832693.017360:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300829056:12345-0@lo:400: 00000100:00100000:3.0:1787832693.017392:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300829056:12345-0@lo:400: Request processed in 32us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.017397:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787832693.017416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300828672 00000100:00100000:3.0:1787832693.017420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300828672 00000100:00100000:3.0:1787832693.017446:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787832693.017452:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300828672:12345-0@lo:400: 00000100:00100000:3.0:1787832693.017487:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300828672:12345-0@lo:400: Request processed in 36us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832693.017494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787832693.017545:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300828928:0@lo:400: 00010000:00080000:3.0:1787832693.017560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b588f00 x1874678300829056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832693.017570:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300829056:0@lo:400: 00000100:00100000:3.0:1787832693.017626:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300828672:0@lo:400: 00000100:00100000:3.0:1787832693.017640:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35591930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300829184:0@lo:400: 00000100:00100000:3.0:1787832693.017654:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300828800:0@lo:400: 00010000:00080000:3.0:1787832693.017666:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565c703c0 x1874678300829312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832693.017676:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300829312:0@lo:400: 00000100:00080000:3.0:1787832693.017733:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787832693.017739:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787832693.101403:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00010000:00010000:3.0:1787832693.451919:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787832694.174093:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000100:00100000:3.0:1787832694.268630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832694.268682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832694.268741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832694.268788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832694.268826:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980992 00000100:00100000:3.0:1787832694.268839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980992 00000100:00100000:3.0:1787832694.268930:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1787832694.268945:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282980992:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1787832694.269077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282980864 00000100:00100000:1.0:1787832694.269082:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282980864 00000100:00100000:1.0:1787832694.269119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787832694.269128:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282980864:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1787832694.269222:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282980864:12345-192.168.201.34@tcp:400: Request processed in 95us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832694.269229:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:3.0:1787832694.270211:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282980992:12345-192.168.201.34@tcp:400: Request processed in 1267us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832694.270222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1787832694.270258:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981120 00000100:00100000:3.0:1787832694.270264:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981120 00000100:00100000:3.0:1787832694.270303:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981248 00000100:00100000:3.0:1787832694.270306:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981248 00000100:00100000:3.0:1787832694.270326:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832694.270333:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282981120:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787832694.270585:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282981120:12345-192.168.201.34@tcp:400: Request processed in 250us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832694.270593:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832694.270607:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787832694.270614:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282981248:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787832694.270644:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282981248:12345-192.168.201.34@tcp:400: Request processed in 31us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832694.270661:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00080000:3.0:1787832694.270680:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787832694.270685:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787832694.270688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787832694.476047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832695.504970:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787832696.324898:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787832696.523938:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832697.547969:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832697.612285:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832697.612321:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300829568:0@lo:13: 00000100:00100000:2.0:1787832697.612426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832697.612519:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829568 00000100:00100000:2.0:1787832697.612528:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829568 00000100:00100000:2.0:1787832697.612598:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787832697.612609:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300829568:12345-0@lo:13: 00002000:00000024:2.0:1787832697.612655:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832697.612784:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300829568:12345-0@lo:13: Request processed in 176us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832697.612793:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787832697.612817:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832697.612854:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565c71680 x1874678300829568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832697.612873:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300829568:0@lo:13: 00000100:00100000:1.0:1787832698.123970:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300829696:0@lo:13: 00000100:00100000:1.0:1787832698.124045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832698.124108:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829696 00000100:00100000:3.0:1787832698.124117:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829696 00000100:00100000:3.0:1787832698.124193:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787832698.124203:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300829696:12345-0@lo:13: 00002000:00000024:3.0:1787832698.124243:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832698.124305:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300829696:12345-0@lo:13: Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832698.124312:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787832698.124355:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2af840 x1874678300829696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832698.124373:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300829696:0@lo:13: 00000100:00080000:1.0:1787832698.124512:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832698.125941:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566094f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300829824:0@lo:400: 00000100:00100000:1.0:1787832698.125998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832698.126032:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300830336:0@lo:400: 00000100:00100000:1.0:1787832698.126057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832698.126080:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832698.126085:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35660952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300830208:0@lo:400: 00000100:00100000:1.0:1787832698.126109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832698.126134:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300829952:0@lo:400: 00000100:00100000:3.0:1787832698.126144:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829824 00000100:00100000:3.0:1787832698.126152:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829824 00000100:00100000:1.0:1787832698.126158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832698.126178:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832698.126184:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35660943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300830080:0@lo:400: 00000100:00100000:3.0:1787832698.126200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787832698.126207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832698.126211:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300829824:12345-0@lo:400: 00000100:00100000:1.0:1787832698.126254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830336 00000100:00100000:1.0:1787832698.126259:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830336 00000100:00100000:1.0:1787832698.126301:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300829952 00000100:00100000:1.0:1787832698.126305:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300829952 00000100:00100000:1.0:1787832698.126314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830080 00000100:00100000:1.0:1787832698.126316:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830080 00000100:00100000:1.0:1787832698.126330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787832698.126335:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300830336:12345-0@lo:400: 00000100:00100000:1.0:1787832698.129075:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300830336:12345-0@lo:400: Request processed in 2729us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832698.129090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787832698.129122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832698.129132:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300829952:12345-0@lo:400: 00000100:00100000:1.0:1787832698.129188:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300829952:12345-0@lo:400: Request processed in 60us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832698.129193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832698.129204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832698.129211:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300830080:12345-0@lo:400: 00000100:00100000:1.0:1787832698.129236:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300830080:12345-0@lo:400: Request processed in 26us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832698.129241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787832698.129648:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832698.130148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300829824:12345-0@lo:400: Request processed in 3935us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832698.130159:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787832698.130235:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830208 00000100:00100000:3.0:1787832698.130242:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830208 00000100:00100000:3.0:1787832698.130294:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787832698.130301:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300830208:12345-0@lo:400: 00000100:00100000:3.0:1787832698.130352:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300830208:12345-0@lo:400: Request processed in 52us (4243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832698.130358:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787832698.130402:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35660952c0 x1874678300830208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832698.130416:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35660952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300830208:0@lo:400: 00000100:00100000:3.0:1787832698.130427:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566094f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300829824:0@lo:400: 00000100:00100000:3.0:1787832698.130439:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300830336:0@lo:400: 00000100:00100000:2.0:1787832698.130548:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35660943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300830080:0@lo:400: 00000100:00100000:2.0:1787832698.130566:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300829952:0@lo:400: 00010000:00010000:0.0:1787832698.574138:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832699.410164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832699.410213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832699.410251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832699.410280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832699.410314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981504 00000100:00100000:0.0:1787832699.410324:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981504 00000100:00100000:0.0:1787832699.410396:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832699.410407:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282981504:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1787832699.410463:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981632 00000100:00100000:1.0:1787832699.410469:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981632 00000100:00100000:0.0:1787832699.410492:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282981504:12345-192.168.201.34@tcp:400: Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832699.410497:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981760 00000100:00100000:1.0:1787832699.410500:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981760 00000100:00100000:0.0:1787832699.410500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1787832699.410515:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787832699.410521:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832699.410522:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678282981632:12345-192.168.201.34@tcp:400: 00000100:00100000:0.0:1787832699.410528:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787832699.410542:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832699.410546:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787832699.410553:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832699.410564:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678282981632:12345-192.168.201.34@tcp:400: Request processed in 43us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832699.410570:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787832699.410582:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832699.410588:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678282981760:12345-192.168.201.34@tcp:400: 00000100:00100000:1.0:1787832699.410611:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678282981760:12345-192.168.201.34@tcp:400: Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832699.410616:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787832699.411117:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981376 00000100:00100000:3.0:1787832699.411123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981376 00000100:00100000:3.0:1787832699.411209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:3.0:1787832699.411216:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678282981376:12345-192.168.201.34@tcp:400: 00000100:00100000:3.0:1787832699.411255:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678282981376:12345-192.168.201.34@tcp:400: Request processed in 40us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832699.411261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00010000:00010000:2.0:1787832699.597103:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832700.627403:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787832700.903538:0:8450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb36eebc0 20000000:00000080:3.0:1787832700.903560:0:8450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c357b4b4400 uarg=0000000000000000 20000000:01000000:3.0:1787832700.903597:0:8450:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787832700.903600:0:8450:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787832700.903603:0:8450:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787832700.903608:0:8450:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787832700.903613:0:8450:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787832700.903626:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787832700.903629:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787832700.904192:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787832700.904198:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787832700.905096:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787832700.905463:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787832700.905507:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787832700.905527:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787832700.905535:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787832700.905536:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787832700.906247:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787832700.906500:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787832700.906526:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787832700.906553:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787832700.906561:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787832700.906563:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787832700.908747:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787832700.909416:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787832700.909453:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787832700.909472:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787832700.909481:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787832700.909483:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787832700.911571:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787832700.912062:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787832700.912126:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787832700.912164:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1787832700.912181:0:8450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787832700.912201:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912221:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912230:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912236:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912242:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912261:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912269:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912276:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912285:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912293:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912300:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912343:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912356:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 9 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912371:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830464:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832700.912487:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912496:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912510:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830592:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832700.912543:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912551:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 18 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912560:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830720:0@lo:104: 00000100:00100000:1.0:1787832700.912611:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832700.912659:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912666:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 18 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912674:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830848:0@lo:104: 00000100:00100000:1.0:1787832700.912731:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832700.912752:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912760:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 18 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912767:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830976:0@lo:104: 00010000:00010000:1.0:1787832700.912788:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912796:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 18 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912811:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831104:0@lo:104: 00010000:00010000:1.0:1787832700.912834:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912841:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 18 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912849:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831232:0@lo:104: 00010000:00010000:1.0:1787832700.912868:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912876:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 18 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912883:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831360:0@lo:104: 00010000:00010000:1.0:1787832700.912905:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.912913:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 18 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.912922:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831488:0@lo:104: 00000100:00100000:1.0:1787832700.912951:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354933b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832700.912953:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787832700.912974:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.912985:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.912992:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.912999:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.913006:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.913012:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830720 00000100:00100000:0.0:1787832700.913018:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830720 00000100:00100000:0.0:1787832700.913048:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830848 00000100:00100000:0.0:1787832700.913050:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830848 00000100:00100000:0.0:1787832700.913057:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300830976 00000100:00100000:0.0:1787832700.913058:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300830976 00000100:00100000:0.0:1787832700.913065:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831104 00000100:00100000:0.0:1787832700.913067:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831104 00000100:00100000:0.0:1787832700.913074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831232 00000100:00100000:0.0:1787832700.913075:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831232 00000100:00100000:0.0:1787832700.913081:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831360 00000100:00100000:0.0:1787832700.913083:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831360 00000100:00100000:0.0:1787832700.913089:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831488 00000100:00100000:0.0:1787832700.913090:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831488 00000100:00100000:0.0:1787832700.913100:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832700.913106:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:8450:x1874678300830720:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913118:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913176:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832700.913182:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+9:8450:x1874678300830720:12345-0@lo:104: Request processed in 76us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913190:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787832700.913209:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830720:0@lo:104: 00000100:00100000:0.0:1787832700.913209:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832700.913219:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354976b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+8:8450:x1874678300830848:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913233:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913281:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787832700.913285:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354976b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+8:8450:x1874678300830848:12345-0@lo:104: Request processed in 69us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832700.913321:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832700.913325:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+7:8450:x1874678300830976:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913330:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913365:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787832700.913368:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+7:8450:x1874678300830976:12345-0@lo:104: Request processed in 44us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913372:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832700.913380:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832700.913383:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+6:8450:x1874678300831104:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913388:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913404:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787832700.913406:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+6:8450:x1874678300831104:12345-0@lo:104: Request processed in 23us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913410:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832700.913416:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787832700.913419:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:8450:x1874678300831232:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913429:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913445:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787832700.913448:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:8450:x1874678300831232:12345-0@lo:104: Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913452:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787832700.913459:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787832700.913462:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:8450:x1874678300831360:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913466:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913484:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787832700.913487:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:8450:x1874678300831360:12345-0@lo:104: Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913490:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787832700.913497:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787832700.913500:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8450:x1874678300831488:12345-0@lo:104: 00010000:00010000:0.0:1787832700.913504:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913517:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787832700.913519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8450:x1874678300831488:12345-0@lo:104: Request processed in 20us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.913523:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787832700.913532:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787832700.913536:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913546:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d800 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913549:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913555:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913559:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913562:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913583:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913588:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913601:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913606:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215d800/0x72bd9178b14b6bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6bc2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913615:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787832700.913617:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913620:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215ca00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913622:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913636:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913653:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913658:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913672:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913677:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913683:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913689:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913699:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787832700.913721:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913725:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913727:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913731:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913735:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913752:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913762:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913766:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913777:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913782:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540031200/0x72bd9178b14b6b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b7c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913787:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787832700.913789:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913792:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913794:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913798:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913802:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913804:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913810:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913813:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913820:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913824:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540030a00/0x72bd9178b14b6b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913830:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787832700.913832:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913835:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913837:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913840:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913844:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913846:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913852:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913855:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913857:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913860:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74c600/0x72bd9178b14b6b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b60 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913865:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832700.913869:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913873:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215de00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913875:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913878:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913881:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913884:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913890:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913893:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913895:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913898:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b36 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913902:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832700.913904:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913907:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832700.913909:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913920:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832700.913924:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832700.913927:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787832700.913933:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913936:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832700.913938:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913941:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d4c00/0x72bd9178b14b6b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b0c expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.913951:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832700.913952:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832700.913953:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832700.913958:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832700.913966:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300831744:0@lo:103: 00000100:00100000:0.0:1787832700.913999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914017:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300832256:0@lo:103: 00000100:00100000:0.0:1787832700.914030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914043:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787832700.914046:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300831616:0@lo:103: 00000100:00100000:0.0:1787832700.914057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914071:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300832128:0@lo:103: 00000100:00100000:0.0:1787832700.914082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914093:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300831872:0@lo:103: 00000100:00100000:0.0:1787832700.914105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300832384:0@lo:103: 00000100:00100000:0.0:1787832700.914119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832700.914127:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300832000:0@lo:103: 00000100:00100000:0.0:1787832700.914141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832700.914158:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831744 00000100:00100000:0.0:1787832700.914161:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831744 00010000:00010000:0.0:1787832700.914176:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 19 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914186:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832256 00000100:00100000:0.0:1787832700.914188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832256 00010000:00010000:0.0:1787832700.914193:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 20 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914198:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831616 00000100:00100000:0.0:1787832700.914199:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831616 00010000:00010000:0.0:1787832700.914204:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 21 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914208:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832128 00000100:00100000:0.0:1787832700.914210:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832128 00010000:00010000:0.0:1787832700.914214:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 22 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914219:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300831872 00000100:00100000:0.0:1787832700.914224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300831872 00010000:00010000:0.0:1787832700.914230:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 23 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914237:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832384 00000100:00100000:0.0:1787832700.914238:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832384 00010000:00010000:0.0:1787832700.914242:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 24 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914247:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832000 00000100:00100000:0.0:1787832700.914248:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832000 00010000:00010000:0.0:1787832700.914252:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 25 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832700.914259:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832700.914262:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+25:3306:x1874678300831744:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914270:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914274:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 25 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914280:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 25 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914290:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914310:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+25:3306:x1874678300831744:12345-0@lo:103: Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832700.914322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832700.914325:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+24:3306:x1874678300832256:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914329:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914336:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 24 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914341:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 24 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914347:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914360:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+24:3306:x1874678300832256:12345-0@lo:103: Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914364:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832700.914371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832700.914375:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+23:3306:x1874678300831616:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914379:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914381:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 23 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914386:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 23 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914392:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215d400/0x72bd9178b14b6bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6bbb expref: 23 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914398:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914408:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+22:3306:x1874678300831616:12345-0@lo:103: Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914411:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832700.914417:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832700.914420:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+21:3306:x1874678300832128:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914424:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914431:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 21 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914436:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 21 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914442:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914454:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+21:3306:x1874678300832128:12345-0@lo:103: Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914459:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832700.914466:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787832700.914469:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3307:x1874678300831872:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914474:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914477:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 20 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914481:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 20 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914487:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914501:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3307:x1874678300831872:12345-0@lo:103: Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914504:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787832700.914510:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787832700.914514:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300832384:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914519:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914522:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 19 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914533:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 19 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914540:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914552:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300832384:12345-0@lo:103: Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787832700.914563:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787832700.914566:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3307:x1874678300832000:12345-0@lo:103: 00010000:00010000:0.0:1787832700.914571:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832700.914573:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 18 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914578:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 18 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832700.914583:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832700.914593:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3307:x1874678300832000:12345-0@lo:103: Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832700.914596:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787832700.914628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300832000:0@lo:103: 00000100:00100000:0.0:1787832700.914636:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300831872:0@lo:103: 00000100:00100000:0.0:1787832700.914658:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300832384:0@lo:103: 00000100:00100000:0.0:1787832700.914686:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300831616:0@lo:103: 00000100:00100000:0.0:1787832700.914693:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300832128:0@lo:103: 00000100:00100000:0.0:1787832700.914723:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300831744:0@lo:103: 00000100:00100000:0.0:1787832700.914727:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300832256:0@lo:103: 00010000:00010000:1.0:1787832700.917567:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d4400/0x72bd9178b14b6b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b91 expref: 17 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917590:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830848:0@lo:104: 00010000:00010000:1.0:1787832700.917623:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b75 expref: 16 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917632:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830976:0@lo:104: 00010000:00010000:1.0:1787832700.917657:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74de00/0x72bd9178b14b6b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b67 expref: 15 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917674:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831104:0@lo:104: 00010000:00010000:1.0:1787832700.917688:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b6b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b59 expref: 14 pid: 5840 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917697:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831232:0@lo:104: 00010000:00010000:1.0:1787832700.917730:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b6b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b2f expref: 13 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917747:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831360:0@lo:104: 00010000:00010000:1.0:1787832700.917759:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d600/0x72bd9178b14b6b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b05 expref: 12 pid: 5839 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.917768:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300831488:0@lo:104: 00010000:00010000:2.0:1787832700.920562:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832700.929065:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830464:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832700.929081:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1874678300830592:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832700.929130:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832700.939124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832700.939188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832700.939329:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282981888 00000100:00100000:1.0:1787832700.939410:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282981888 00010000:00010000:1.0:1787832700.939450:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 10 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.939488:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982016 00000100:00100000:1.0:1787832700.939492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982016 00010000:00010000:1.0:1787832700.939505:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 11 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832700.939536:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787832700.939545:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:2353:x1874678282981888:12345-192.168.201.34@tcp:103: 00010000:00010000:1.0:1787832700.939560:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832700.939565:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.939579:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.939599:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706608 expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832700.939616:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832700.939694:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282981888:12345-192.168.201.34@tcp:103: Request processed in 140us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832700.939837:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787832700.939855:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787832700.940336:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1787832700.944890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787832700.944915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:2352:x1874678282982016:12345-192.168.201.34@tcp:103: 00010000:00010000:2.0:1787832700.944935:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832700.944945:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.944962:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.944983:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706601 expref: 9 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945000:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945009:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945026:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945033:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945041:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945070:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945076:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832700.945080:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945089:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945107:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.945120:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832700.945186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:2352:x1874678282982016:12345-192.168.201.34@tcp:103: Request processed in 282us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832700.945196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:2.0:1787832700.947166:0:8450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.947186:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832700.947194:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40000/0x72bd9178b14b6c0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832701.644226:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832702.009732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832702.009933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982144 00000100:00100000:1.0:1787832702.009944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982144 00000100:00100000:1.0:1787832702.010001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:1.0:1787832702.010012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+8:5598:x1874678282982144:12345-192.168.201.34@tcp:101: 00010000:00010000:1.0:1787832702.010028:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832702.010050:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b6c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b70666a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.010083:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b6c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70666a expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.010113:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b6c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70666a expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.010124:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40800, rc 0) 00000100:00100000:1.0:1787832702.010199:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982144:12345-192.168.201.34@tcp:101: Request processed in 189us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.010207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:2.0:1787832702.012045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832702.012134:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982272 00000100:00100000:0.0:1787832702.012157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982272 00000100:00100000:0.0:1787832702.012209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:0.0:1787832702.012219:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982272:12345-192.168.201.34@tcp:501: 00000100:00100000:0.0:1787832702.012874:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982272:12345-192.168.201.34@tcp:501: Request processed in 388us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832702.012886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:3.0:1787832702.016092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832702.026285:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982400 00000100:00100000:1.0:1787832702.026300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982400 00000100:00100000:1.0:1787832702.026375:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:1.0:1787832702.026386:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982400:12345-192.168.201.34@tcp:503: 00000100:00100000:1.0:1787832702.027091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982400:12345-192.168.201.34@tcp:503: Request processed in 702us (11005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.027101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:3.0:1787832702.044074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832702.044199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982528 00000100:00100000:0.0:1787832702.044210:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982528 00000100:00100000:0.0:1787832702.044270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:0.0:1787832702.044281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:6067:x1874678282982528:12345-192.168.201.34@tcp:502: 00000100:00100000:0.0:1787832702.044579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:6067:x1874678282982528:12345-192.168.201.34@tcp:502: Request processed in 298us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832702.044588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1787832702.057357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832702.057572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982656 00000100:00100000:3.0:1787832702.057586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982656 00000100:00100000:3.0:1787832702.057670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1787832702.057692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:6067:x1874678282982656:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832702.058075:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:6067:x1874678282982656:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 394us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.058084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1787832702.069627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832702.070310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982784 00000100:00100000:1.0:1787832702.070331:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982784 00000100:00100000:1.0:1787832702.070393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:1.0:1787832702.070404:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282982784:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787832702.070421:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832702.070439:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41600/0x72bd9178b14b6c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706671 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.070471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41600/0x72bd9178b14b6c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706671 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.070482:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41600/0x72bd9178b14b6c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706671 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.070506:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41600, rc 0) 00000100:00100000:1.0:1787832702.070574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282982784:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 171us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.070581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:2.0:1787832702.075081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832702.075197:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282982912 00000100:00100000:0.0:1787832702.075207:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282982912 00000100:00100000:0.0:1787832702.075259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:0.0:1787832702.075269:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282982912:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832702.078251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282982912:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 2971us (3169us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787832702.078267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00010000:00010000:0.0:1787832702.670077:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832702.732128:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832702.732177:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300832512:0@lo:13: 00000100:00100000:0.0:1787832702.732267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832702.732354:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832512 00000100:00100000:0.0:1787832702.732361:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832512 00000100:00100000:0.0:1787832702.732429:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787832702.732440:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300832512:12345-0@lo:13: 00002000:00000024:0.0:1787832702.732490:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832702.732543:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300832512:12345-0@lo:13: Request processed in 104us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832702.732550:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787832702.732574:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787832702.732623:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b04780 x1874678300832512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832702.732645:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300832512:0@lo:13: 10000000:01000000:1.0:1787832702.923907:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787832702.923918:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357b0a1800 from 39 10000000:01000000:1.0:1787832702.924000:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787832702.924065:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.924079:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.924092:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832702.924126:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832640:0@lo:101: 00000100:00100000:1.0:1787832702.925065:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.925196:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354933ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.931691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832640 00000100:00100000:3.0:1787832702.931725:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832640 00000100:00100000:3.0:1787832702.931824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787832702.931839:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+12:5842:x1874678300832640:12345-0@lo:101: 00010000:00010000:3.0:1787832702.931864:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832702.931902:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c24 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.931953:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c24 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.931968:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c24 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.931980:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215c000, rc 0) 00000100:00100000:3.0:1787832702.932143:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300832640:12345-0@lo:101: Request processed in 301us (7075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.932152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787832702.932242:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832640:0@lo:101: 00010000:00010000:3.0:1787832702.932266:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.932279:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832702.932383:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832768:0@lo:501: 00000100:00100000:3.0:1787832702.932424:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.932469:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.932489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832768 00000100:00100000:3.0:1787832702.932504:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832768 00000100:00100000:3.0:1787832702.932533:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787832702.932540:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300832768:12345-0@lo:501: 00000100:00100000:3.0:1787832702.932987:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300832768:12345-0@lo:501: Request processed in 445us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.932997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787832702.933036:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832768:0@lo:501: 00000100:00100000:3.0:1787832702.933086:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832896:0@lo:503: 00000100:00100000:3.0:1787832702.933133:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.933150:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.933163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300832896 00000100:00100000:3.0:1787832702.933168:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300832896 00000100:00100000:3.0:1787832702.933190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787832702.933197:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300832896:12345-0@lo:503: 00000100:00100000:3.0:1787832702.933366:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300832896:12345-0@lo:503: Request processed in 169us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.933374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787832702.933412:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300832896:0@lo:503: 00000100:00100000:3.0:1787832702.933739:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8486:1874678300833024:0@lo:502: 00000100:00100000:3.0:1787832702.933776:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.933807:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833024 00000100:00100000:3.0:1787832702.933811:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833024 00000100:00100000:3.0:1787832702.933835:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787832702.933842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:8486:x1874678300833024:12345-0@lo:502: 00000100:00100000:3.0:1787832702.934024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:8486:x1874678300833024:12345-0@lo:502: Request processed in 182us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.934031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787832702.934062:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.934077:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8486:1874678300833024:0@lo:502: 00000100:00100000:3.0:1787832702.934114:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8486:1874678300833152:0@lo:502: 00000100:00100000:3.0:1787832702.934146:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.934165:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833152 00000100:00100000:3.0:1787832702.934168:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833152 00000100:00100000:3.0:1787832702.934187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787832702.934193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:8486:x1874678300833152:12345-0@lo:502: 00000100:00100000:3.0:1787832702.934300:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+13:8486:x1874678300833152:12345-0@lo:502: Request processed in 106us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.934307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787832702.934330:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.934340:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8486:1874678300833152:0@lo:502: 00000040:00080000:3.0:1787832702.934355:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787832702.934412:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787832702.934432:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787832702.934441:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.934453:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832702.934469:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787832702.934472:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787832702.934475:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787832702.934503:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.934512:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.934521:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832702.934534:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833280:0@lo:101: 00000100:00100000:3.0:1787832702.934560:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.934574:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.934585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833280 00000100:00100000:3.0:1787832702.934588:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833280 00000100:00100000:0.0:1787832702.937846:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787832702.937878:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+13:5842:x1874678300833280:12345-0@lo:101: 00010000:00010000:0.0:1787832702.937903:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832702.937937:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c32 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832702.937976:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c32 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832702.937989:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c32 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832702.938021:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031200, rc 0) 00000100:00100000:0.0:1787832702.938154:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833280:12345-0@lo:101: Request processed in 292us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832702.938163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787832702.941445:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833280:0@lo:101: 00010000:00010000:0.0:1787832702.941487:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832702.941513:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832702.941785:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833408:0@lo:501: 00000100:00100000:0.0:1787832702.941897:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.942277:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833408 00000100:00100000:2.0:1787832702.942286:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833408 00000100:00100000:2.0:1787832702.942345:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787832702.942356:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833408:12345-0@lo:501: 00000100:00100000:0.0:1787832702.942843:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786840 going to sleep for 11 seconds 00000100:00100000:2.0:1787832702.946692:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833408:12345-0@lo:501: Request processed in 4309us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832702.946728:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787832702.949515:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833408:0@lo:501: 00000100:00100000:0.0:1787832702.949602:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833536:0@lo:503: 00000100:00100000:0.0:1787832702.950089:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832702.950137:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.950209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833536 00000100:00100000:3.0:1787832702.950337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833536 00000100:00100000:3.0:1787832702.950408:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787832702.950420:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833536:12345-0@lo:503: 00000100:00100000:3.0:1787832702.950888:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833536:12345-0@lo:503: Request processed in 459us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.950900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787832702.952008:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833536:0@lo:503: 00000100:00100000:1.0:1787832702.953167:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8487:1874678300833664:0@lo:502: 00000100:00100000:1.0:1787832702.953394:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.953486:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354933b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.954571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833664 00000100:00100000:3.0:1787832702.954584:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833664 00000100:00100000:3.0:1787832702.954730:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787832702.954746:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:8487:x1874678300833664:12345-0@lo:502: 00000100:00100000:3.0:1787832702.955580:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+14:8487:x1874678300833664:12345-0@lo:502: Request processed in 833us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.955591:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787832702.955759:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8487:1874678300833664:0@lo:502: 00000020:01000000:1.0:1787832702.955813:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787832702.955828:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832702.955842:0:8487:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787832702.955851:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787832702.955923:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8487:1874678300833792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832702.955994:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.956692:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354933b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832702.959376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833792 00000100:00100000:2.0:1787832702.959399:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833792 00000100:00100000:2.0:1787832702.959484:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787832702.959562:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:8487:x1874678300833792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832702.960455:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:8487:x1874678300833792:12345-0@lo:502:llog_process_th.0 Request processed in 957us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832702.960468:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787832702.961151:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8487:1874678300833792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787832702.961211:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832702.961352:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832702.961355:0:8487:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787832702.961365:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787832702.961909:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787832702.962062:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787832702.962077:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.962092:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832702.962106:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787832702.962110:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357c687800 from 39 10000000:01000000:2.0:1787832702.962114:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787832702.962166:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.962176:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.962205:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832702.962356:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.962435:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.962545:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787832702.963067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300833920 00000100:00100000:0.0:1787832702.963078:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300833920 00000100:00100000:3.0:1787832702.963184:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787832702.963199:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+14:5842:x1874678300833920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832702.963335:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832702.963357:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215c800/0x72bd9178b14b6c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.963389:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215c800/0x72bd9178b14b6c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c40 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.963401:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215c800/0x72bd9178b14b6c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c40 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.963411:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215c800, rc 0) 00000100:00100000:3.0:1787832702.963482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300833920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.963555:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787832702.963681:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300833920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832702.964126:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.964141:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832702.964346:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.964398:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.964441:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.964487:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834048 00000100:00100000:3.0:1787832702.964555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834048 00000100:00100000:3.0:1787832702.964601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787832702.964618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300834048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.965412:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300834048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 793us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.965422:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787832702.965527:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832702.965578:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832702.965637:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.965672:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354933b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.966146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834176 00000100:00100000:3.0:1787832702.966163:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834176 00000100:00100000:3.0:1787832702.966197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787832702.966205:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300834176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.966645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300834176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.966654:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787832702.967727:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.969572:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8488:1874678300834304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832702.969726:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.969788:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.970178:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834304 00000100:00100000:3.0:1787832702.970187:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834304 00000100:00100000:3.0:1787832702.970375:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787832702.970386:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:8488:x1874678300834304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832702.972394:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:8488:x1874678300834304:12345-0@lo:502:llog_process_th.0 Request processed in 1995us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.972411:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787832702.973209:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8488:1874678300834304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832702.973444:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8488:1874678300834432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832702.974478:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.974561:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674600 going to sleep for 11 seconds 00000100:00100000:1.0:1787832702.974743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834432 00000100:00100000:1.0:1787832702.974752:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834432 00000100:00100000:1.0:1787832702.974825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787832702.974836:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:8488:x1874678300834432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832702.975191:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:8488:x1874678300834432:12345-0@lo:502:llog_process_th.0 Request processed in 355us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.975200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787832702.976023:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8488:1874678300834432:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787832702.976072:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787832702.976541:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787832702.976583:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787832702.976596:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.976621:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832702.976633:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787832702.976636:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787832702.976640:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787832702.976698:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.976739:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.976751:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832702.976781:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832702.976865:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.976920:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356011a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.977454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834560 00000100:00100000:3.0:1787832702.977464:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834560 00000100:00100000:3.0:1787832702.977561:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787832702.977574:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+15:5842:x1874678300834560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832702.977592:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832702.977623:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6c55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c4e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.977656:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c4e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.978077:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c4e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.978091:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c358215da00, rc 0) 00000100:00100000:3.0:1787832702.978178:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300834560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 606us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.978186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787832702.978395:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787832702.978429:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832702.978441:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832702.978537:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832702.978597:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832702.978647:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356011a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787832702.978744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834688 00000100:00100000:2.0:1787832702.978750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834688 00000100:00100000:2.0:1787832702.978800:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787832702.978823:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300834688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.979534:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300834688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 712us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832702.979554:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787832702.979620:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.979668:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.979743:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.979761:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.980164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834816 00000100:00100000:3.0:1787832702.980171:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834816 00000100:00100000:3.0:1787832702.980602:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787832702.980623:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300834816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.981059:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300834816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 438us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.981068:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787832702.981536:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300834816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832702.982472:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8489:1874678300834944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832702.982640:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.982768:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832702.983182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300834944 00000100:00100000:1.0:1787832702.983191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300834944 00000100:00100000:1.0:1787832702.983399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787832702.983411:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:8489:x1874678300834944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832702.983768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+16:8489:x1874678300834944:12345-0@lo:502:llog_process_th.0 Request processed in 359us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832702.983777:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787832702.983895:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8489:1874678300834944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832702.984195:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832702.984209:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832702.984211:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787832702.984231:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787832702.984268:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8489:1874678300835072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832702.984321:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832702.984677:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3550841900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832702.984853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835072 00000100:00100000:3.0:1787832702.984861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835072 00000100:00100000:3.0:1787832702.984914:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787832702.985088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:8489:x1874678300835072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832702.985355:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:8489:x1874678300835072:12345-0@lo:502:llog_process_th.0 Request processed in 431us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.985363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787832702.985519:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8489:1874678300835072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832702.985550:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832702.985558:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832702.985560:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787832702.985566:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787832702.986140:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787832702.986172:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787832702.986185:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.986226:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832702.986238:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787832702.986242:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3543878800 from 39 10000000:01000000:3.0:1787832702.986245:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787832702.986286:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.986296:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.986305:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832702.986330:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.986384:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.986419:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832702.986599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835200 00000100:00100000:2.0:1787832702.986616:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835200 00000100:00100000:2.0:1787832702.986650:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787832702.986677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300835200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832702.986699:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832702.986736:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b6c63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c5c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.986764:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b6c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c5c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.986777:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b6c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c5c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832702.986787:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74ca00, rc 0) 00000100:00100000:2.0:1787832702.986840:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832702.986847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787832702.992069:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832702.992127:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832702.992144:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832702.994409:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.997882:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832702.998123:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835328 00000100:00100000:3.0:1787832702.998134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835328 00000100:00100000:3.0:1787832702.998202:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787832702.998352:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832702.998865:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 651us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832702.998874:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787832703.003721:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832703.003786:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832703.003896:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832703.004197:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832703.004379:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.004482:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835456 00000100:00100000:0.0:1787832703.004503:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835456 00000100:00100000:0.0:1787832703.004582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787832703.004595:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832703.005179:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 583us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832703.005198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787832703.005629:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832703.007536:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8491:1874678300835584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832703.007646:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832703.007697:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.008091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835584 00000100:00100000:0.0:1787832703.008100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835584 00000100:00100000:0.0:1787832703.008167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787832703.008178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8491:x1874678300835584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832703.010440:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8491:x1874678300835584:12345-0@lo:502:llog_process_th.0 Request processed in 2253us (2784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832703.010458:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787832703.010682:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8491:1874678300835584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832703.015104:0:8491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b06940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8491:1874678300835712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832703.015362:0:8491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.015430:0:8491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832703.015624:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835712 00000100:00100000:3.0:1787832703.015636:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835712 00000100:00100000:3.0:1787832703.015753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787832703.015765:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8491:x1874678300835712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832703.016560:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8491:x1874678300835712:12345-0@lo:502:llog_process_th.0 Request processed in 792us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832703.016584:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787832703.017653:0:8491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b06940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8491:1874678300835712:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787832703.017750:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787832703.018913:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787832703.019021:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787832703.019037:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.019050:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832703.019064:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787832703.019067:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787832703.019071:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787832703.019127:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.019138:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.019150:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.019187:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832703.020393:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832703.020540:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.028083:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835840 00000100:00100000:0.0:1787832703.028110:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835840 00000100:00100000:1.0:1787832703.028315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787832703.028328:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300835840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787832703.028355:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832703.028382:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b6c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.028420:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b6c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c6a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.028433:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b6c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c6a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.028444:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41a00, rc 0) 00000100:00100000:1.0:1787832703.028567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300835840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (8183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832703.028576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787832703.028683:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787832703.028729:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.028754:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832703.029327:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832703.029379:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832703.029427:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af54a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.030036:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300835968 00000100:00100000:0.0:1787832703.030045:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300835968 00000100:00100000:0.0:1787832703.030089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787832703.030099:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300835968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832703.030466:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300835968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832703.032031:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787832703.032184:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300835968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832703.032325:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832703.032408:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832703.032460:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af54a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.032584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836096 00000100:00100000:0.0:1787832703.032591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836096 00000100:00100000:0.0:1787832703.032654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787832703.032665:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300836096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832703.033648:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300836096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 980us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832703.033678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787832703.035680:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832703.040825:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8493:1874678300836224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832703.041079:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832703.041133:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35508416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832703.041353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836224 00000100:00100000:0.0:1787832703.041365:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836224 00000100:00100000:0.0:1787832703.041433:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787832703.041445:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8493:x1874678300836224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832703.042204:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8493:x1874678300836224:12345-0@lo:502:llog_process_th.0 Request processed in 758us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.042334:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787832703.042439:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8493:1874678300836224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832703.042479:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832703.042490:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832703.042493:0:8493:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787832703.042503:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787832703.042538:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b06940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8493:1874678300836352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832703.042582:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.042630:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832703.042698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836352 00000100:00100000:1.0:1787832703.042738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836352 00000100:00100000:1.0:1787832703.042790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787832703.042799:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8493:x1874678300836352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832703.043389:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8493:x1874678300836352:12345-0@lo:502:llog_process_th.0 Request processed in 590us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832703.043399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787832703.046423:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b06940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8493:1874678300836352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832703.046489:0:8493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832703.046502:0:8493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832703.046505:0:8493:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787832703.046512:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787832703.047053:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787832703.047089:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787832703.047104:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.047139:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832703.047153:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787832703.047156:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3543794d28 from 1 10000000:01000000:3.0:1787832703.047160:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787832703.047208:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.047393:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.047405:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.047433:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832703.047526:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832703.047626:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787832703.059823:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836480 00000100:00100000:2.0:1787832703.059844:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836480 00000100:00100000:2.0:1787832703.061119:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787832703.061136:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300836480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832703.061163:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832703.061189:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b6c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c78 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.062799:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b6c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c78 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.062893:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b6c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c78 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.062906:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d400, rc 0) 00000100:00100000:2.0:1787832703.063100:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300836480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1966us (15572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.063112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787832703.063401:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832703.063441:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.063452:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832703.063560:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832703.063615:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.063665:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832703.064995:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836608 00000100:00100000:2.0:1787832703.065007:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836608 00000100:00100000:2.0:1787832703.065073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787832703.065083:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300836608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832703.066505:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300836608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1417us (2893us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787832703.066520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787832703.067384:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300836608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787832703.067441:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787832703.067464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.067476:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832703.245418:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300836736:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.245522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.245613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300837248:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.245647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.245698:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832703.245724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300836864:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.245750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.245786:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300836992:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.245824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.245844:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832703.245850:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300837120:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.245872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.245907:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836736 00000100:00100000:0.0:1787832703.245916:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836736 00000100:00100000:2.0:1787832703.247172:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836864 00000100:00100000:2.0:1787832703.247182:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836864 00000100:00100000:2.0:1787832703.247330:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837120 00000100:00100000:2.0:1787832703.247335:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837120 00000100:00100000:2.0:1787832703.247362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787832703.247373:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300836864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832703.247484:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300836864:12345-0@lo:400:kworker.0 Request processed in 112us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.247493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787832703.247512:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787832703.247519:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300837120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832703.247557:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300837120:12345-0@lo:400:kworker.0 Request processed in 39us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.247563:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787832703.247585:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837248 00000100:00100000:2.0:1787832703.247590:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837248 00000100:00100000:2.0:1787832703.247629:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300836992 00000100:00100000:2.0:1787832703.247633:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300836992 00000100:00100000:2.0:1787832703.247656:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832703.247672:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832703.247749:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300837248:12345-0@lo:400:kworker.0 Request processed in 86us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.247756:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832703.247767:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832703.247774:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300836992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.249099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787832703.249111:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300836736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.249183:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300836736:12345-0@lo:400:kworker.0 Request processed in 74us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832703.249190:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787832703.250365:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300836992:12345-0@lo:400:kworker.0 Request processed in 2584us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.250377:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787832703.250946:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832703.250954:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832703.250994:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300837376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832703.251071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.251187:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300837120:0@lo:400:kworker.0 00010000:00080000:0.0:1787832703.251207:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b05e00 x1874678300836992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832703.251218:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300836992:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.251787:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300836864:0@lo:400:kworker.0 00000100:00100000:0.0:1787832703.251804:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300836736:0@lo:400:kworker.0 00010000:00080000:0.0:1787832703.251817:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b061c0 x1874678300837248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832703.251827:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300837248:0@lo:400:kworker.0 00000020:00000080:3.0:1787832703.252464:0:8510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0ae90b40 20000000:00000080:3.0:1787832703.252483:0:8510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c354976ac00 uarg=0000000000000000 20000000:01000000:3.0:1787832703.252530:0:8510:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787832703.252539:0:8510:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787832703.252548:0:8510:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000100:00100000:2.0:1787832703.253057:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837376 00000100:00100000:2.0:1787832703.253067:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837376 00000100:00100000:2.0:1787832703.253125:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787832703.253135:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300837376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832703.253192:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1787832703.253976:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565c72580 x1874678300837376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832703.254001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300837376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832703.254136:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300837376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1001us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.254145:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000040:00080000:1.0:1787832703.261409:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787832703.262832:0:8510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787832703.275053:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787832703.275684:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787832703.275796:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787832703.275826:0:8510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787832703.275851:0:8510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276056:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276064:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276070:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276080:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276089:0:8510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276135:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276165:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 9 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.276182:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837504:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832703.276304:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.276312:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.277437:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837632:0@lo:104: 00000100:00100000:3.0:1787832703.277501:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787832703.277572:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832703.277646:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837632 00000100:00100000:1.0:1787832703.277661:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837632 00000100:00100000:1.0:1787832703.280394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787832703.280618:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8510:x1874678300837632:12345-0@lo:104: 00010000:00010000:1.0:1787832703.280647:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.280812:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832703.280819:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8510:x1874678300837632:12345-0@lo:104: Request processed in 395us (3317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832703.280837:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787832703.280848:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832703.280935:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.280947:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832703.280951:0:7636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.281032:0:7636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832703.281041:0:7636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832703.281046:0:7636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787832703.281119:0:7636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.281125:0:7636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787832703.281165:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.281174:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5c00/0x72bd9178b14b6b21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6b28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.281189:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832703.281207:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832703.281211:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832703.281223:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832703.281242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300837888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787832703.281310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787832703.282452:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.282482:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837760:0@lo:104: 00000100:00100000:3.0:1787832703.282583:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832703.283209:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837888 00000100:00100000:2.0:1787832703.283223:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837888 00010000:00010000:2.0:1787832703.283266:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 19 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832703.283309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787832703.283328:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300837888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832703.283343:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832703.283349:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 19 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.283362:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 19 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.284382:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832703.284451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300837888:12345-0@lo:103:ldlm_bl.0 Request processed in 1131us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.284462:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787832703.284993:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832703.285017:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.285034:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300838016:0@lo:104: 00000100:00100000:3.0:1787832703.285083:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464c1180 going to sleep for 11 seconds 00010000:00010000:3.0:1787832703.285116:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215c400/0x72bd9178b14b6b28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6b21 expref: 18 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832703.285130:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837632:0@lo:104: 00000100:00100000:2.0:1787832703.285353:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787832703.285385:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.285578:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300837888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787832703.286069:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300837760 00000100:00100000:2.0:1787832703.286078:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300837760 00000100:00100000:3.0:1787832703.288527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832703.288611:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837504:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832703.290176:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983040 00000100:00100000:0.0:1787832703.290195:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983040 00010000:00010000:0.0:1787832703.290288:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832703.290342:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1787832703.290354:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282983040:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832703.290374:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832703.290399:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.290414:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.290438:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6be5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706639 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.290461:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832703.290551:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:2353:x1874678282983040:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 198us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832703.290559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787832703.291752:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838016 00000100:00100000:1.0:1787832703.291763:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838016 00000100:00100000:2.0:1787832703.292790:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787832703.292814:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b78b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:8510:x1874678300837760:12345-0@lo:104: 00010000:00010000:2.0:1787832703.292834:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.292994:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787832703.293001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b78b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:8510:x1874678300837760:12345-0@lo:104: Request processed in 198us (10423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.293009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787832703.293066:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832703.293073:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.293080:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832703.293085:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.293093:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832703.293100:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832703.293106:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787832703.293328:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300837760:0@lo:104: 00010000:00010000:2.0:1787832703.293420:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.293429:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787832703.293850:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787832703.293868:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8510:x1874678300838016:12345-0@lo:104: 00010000:00010000:1.0:1787832703.293888:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294376:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832703.294386:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:8510:x1874678300838016:12345-0@lo:104: Request processed in 523us (8999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832703.294397:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787832703.294426:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832703.294432:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294442:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832703.294446:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294457:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832703.294465:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832703.294489:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787832703.294535:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294543:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832703.294573:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294581:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5400/0x72bd9178b14b69f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b69fb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832703.294614:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832703.294618:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832703.294620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832703.294646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832703.294677:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300838272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832703.295100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832703.297160:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874678300838016:0@lo:104: 00010000:00010000:0.0:1787832703.297209:0:8510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.309764:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.309780:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d4200/0x72bd9178b14b6a56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6a5d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832703.309926:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832703.309952:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300838144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787832703.310025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832703.310084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838272 00000100:00100000:2.0:1787832703.310092:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838272 00010000:00010000:2.0:1787832703.310127:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832703.310164:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838144 00000100:00100000:2.0:1787832703.310168:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838144 00010000:00010000:2.0:1787832703.310180:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 19 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832703.310202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832703.310209:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300838272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832703.310223:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832703.310229:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310240:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310259:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d800/0x72bd9178b14b69fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b69f4 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310272:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832703.310312:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3307:x1874678300838272:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (15218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.310329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832703.310348:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787832703.310354:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:3306:x1874678300838144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832703.310362:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832703.310367:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310375:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310385:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74ce00/0x72bd9178b14b6a5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6a56 expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310396:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310405:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310420:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310427:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310434:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310441:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310459:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832703.310464:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310475:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310496:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.310507:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832703.310537:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300838144:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832703.310545:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787832703.310614:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300838144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787832703.310655:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300838272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832703.310676:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832703.310679:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832703.310680:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832703.311510:0:8510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.311522:0:8510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832703.311529:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215d800/0x72bd9178b14b6c86 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832703.693080:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832704.059957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832704.060070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983168 00000100:00100000:3.0:1787832704.060088:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983168 00000100:00100000:3.0:1787832704.060170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:3.0:1787832704.060186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:5598:x1874678282983168:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832704.060210:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832704.060261:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706678 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.060307:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.060321:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.060334:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86800, rc 0) 00000100:00100000:3.0:1787832704.060416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282983168:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 236us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.060424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:0.0:1787832704.073862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832704.073949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983296 00000100:00100000:1.0:1787832704.073960:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983296 00000100:00100000:1.0:1787832704.074018:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:1.0:1787832704.074029:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282983296:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832704.074343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282983296:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 314us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832704.074351:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:0.0:1787832704.087377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832704.089896:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983424 00000100:00100000:1.0:1787832704.089916:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983424 00000100:00100000:1.0:1787832704.089993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:1.0:1787832704.090004:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282983424:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832704.090264:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:5598:x1874678282983424:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 260us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832704.090272:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:1.0:1787832704.092965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832704.093037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983552 00000100:00100000:2.0:1787832704.093046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983552 00000100:00100000:2.0:1787832704.093093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:2.0:1787832704.093100:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:6124:x1874678282983552:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787832704.093347:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:6124:x1874678282983552:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 247us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.093361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:1.0:1787832704.099998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832704.100061:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983680 00000100:00100000:3.0:1787832704.100070:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983680 00000100:00100000:3.0:1787832704.100113:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:3.0:1787832704.100121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:6124:x1874678282983680:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832704.100371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:6124:x1874678282983680:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 249us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.100381:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:1.0:1787832704.506773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832704.506825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832704.506848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832704.507020:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983936 00000100:00100000:2.0:1787832704.507033:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983936 00000100:00100000:2.0:1787832704.507094:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984064 00000100:00100000:2.0:1787832704.507097:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984064 00000100:00100000:2.0:1787832704.507120:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787832704.507128:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678282983936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832704.507217:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678282983936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 89us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.507224:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787832704.507239:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787832704.507245:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678282984064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832704.507272:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678282984064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.507279:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:2.0:1787832704.507296:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832704.507297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282983808 00000100:00080000:2.0:1787832704.507300:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832704.507302:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282983808 00000100:00100000:0.0:1787832704.507337:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1787832704.507343:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282983808:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832704.507373:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282983808:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.507380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00080000:2.0:1787832704.507413:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832704.722213:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787832704.722804:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832704.722809:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a1800 from 4 10000000:01000000:2.0:1787832704.722814:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832704.722883:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832704.722895:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832704.722921:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832704.722950:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832704.723032:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832704.723092:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.723145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838400 00000100:00100000:0.0:1787832704.723153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838400 00000100:00100000:0.0:1787832704.723209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787832704.723220:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300838400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832704.723235:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832704.723251:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6c94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.723275:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.723287:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.723296:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00100000:0.0:1787832704.723341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300838400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.723348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787832704.723398:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832704.723415:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.723430:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832704.723488:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.723512:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.723526:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.723538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838528 00000100:00100000:0.0:1787832704.723541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838528 00000100:00100000:0.0:1787832704.723559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787832704.723564:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300838528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.723854:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300838528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.723862:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787832704.723893:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.723927:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.723964:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.723978:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.723990:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838656 00000100:00100000:0.0:1787832704.723993:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838656 00000100:00100000:0.0:1787832704.724010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787832704.724017:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300838656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.724147:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300838656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.724153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787832704.724195:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300838656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.724354:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8556:1874678300838784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.724385:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.724400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838784 00000100:00100000:0.0:1787832704.724403:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838784 00000100:00100000:0.0:1787832704.724420:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787832704.724425:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8556:x1874678300838784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.724524:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8556:x1874678300838784:12345-0@lo:502:llog_process_th.0 Request processed in 98us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.724531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787832704.724553:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786540 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.724563:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8556:1874678300838784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832704.724593:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832704.724603:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832704.724605:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787832704.724612:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357b0a1800 00000020:00000080:0.0:1787832704.724615:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787832704.724691:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8556:1874678300838912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.724743:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.724764:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300838912 00000100:00100000:0.0:1787832704.724769:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300838912 00000100:00100000:0.0:1787832704.724792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787832704.724797:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8556:x1874678300838912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.724914:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:8556:x1874678300838912:12345-0@lo:502:llog_process_th.0 Request processed in 115us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.724921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787832704.724963:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786540 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.724978:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8556:1874678300838912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832704.724996:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832704.725001:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832704.725002:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787832704.725006:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787832704.725054:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787832704.725071:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787832704.725079:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.726789:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832704.726805:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787832704.726809:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357c687800 from 4 10000000:01000000:0.0:1787832704.726812:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787832704.726856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.726866:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.726876:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832704.726898:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.726958:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.726999:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786540 going to sleep for 11 seconds 00000100:00100000:0.0:1787832704.727021:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839040 00000100:00100000:0.0:1787832704.727033:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839040 00000100:00100000:0.0:1787832704.727077:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787832704.727087:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300839040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832704.727098:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832704.727110:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6ca2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.727134:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.727150:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.727160:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832704.727194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832704.727200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787832704.727243:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832704.727255:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832704.727264:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832704.727308:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.727328:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.727348:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786540 going to sleep for 11 seconds 00000100:00100000:3.0:1787832704.727371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839168 00000100:00100000:3.0:1787832704.727377:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839168 00000100:00100000:3.0:1787832704.727409:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787832704.727417:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.727856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.727881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787832704.728059:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.728102:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.728137:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.728160:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786540 going to sleep for 11 seconds 00000100:00100000:3.0:1787832704.728177:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839296 00000100:00100000:3.0:1787832704.728182:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839296 00000100:00100000:3.0:1787832704.728217:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787832704.728227:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.728382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.728390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787832704.730972:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832704.731206:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8560:1874678300839424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.731284:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.731318:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832704.736291:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839424 00000100:00100000:3.0:1787832704.736307:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839424 00000100:00100000:3.0:1787832704.736364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787832704.736374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8560:x1874678300839424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832704.736686:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8560:x1874678300839424:12345-0@lo:502:llog_process_th.0 Request processed in 305us (5394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.736695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787832704.738067:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8560:1874678300839424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832704.738108:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832704.738119:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832704.738121:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787832704.738129:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357c687800 00000020:00000080:0.0:1787832704.738132:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787832704.738224:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8560:1874678300839552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832704.738283:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832704.738330:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832704.739064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839552 00000100:00100000:2.0:1787832704.739073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839552 00000100:00100000:2.0:1787832704.739120:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787832704.739130:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8560:x1874678300839552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832704.739354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:8560:x1874678300839552:12345-0@lo:502:llog_process_th.0 Request processed in 225us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.739362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787832704.740861:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8560:1874678300839552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832704.740910:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832704.740918:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832704.740921:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787832704.740926:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787832704.741043:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787832704.741070:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787832704.741082:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.741094:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832704.741105:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787832704.741108:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3543878800 from 4 10000000:01000000:3.0:1787832704.741111:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787832704.741145:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.741154:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.741170:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832704.741190:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.741242:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832704.741285:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832704.741447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839680 00000100:00100000:2.0:1787832704.741454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839680 00000100:00100000:2.0:1787832704.741499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787832704.741509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300839680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832704.741523:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832704.741537:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6cb0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832704.741929:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832704.741942:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832704.741951:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c400, rc 0) 00000100:00100000:2.0:1787832704.742004:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300839680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 496us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.742011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787832704.742047:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832704.742063:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832704.742073:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832704.742125:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.742152:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832704.742173:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832704.746976:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839808 00000100:00100000:2.0:1787832704.746990:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839808 00000100:00100000:2.0:1787832704.747056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787832704.747068:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300839808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832704.747379:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300839808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.747388:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787832704.747400:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.747447:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.747482:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832704.747510:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832704.747950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300839936 00000100:00100000:2.0:1787832704.747956:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300839936 00000100:00100000:2.0:1787832704.747988:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787832704.747997:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300839936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832704.748163:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300839936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832704.748172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787832704.748178:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300839936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832704.757377:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8562:1874678300840064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832704.757477:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832704.757589:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832704.757991:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840064 00000100:00100000:2.0:1787832704.758003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840064 00000100:00100000:3.0:1787832704.758165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787832704.758175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:8562:x1874678300840064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832704.758451:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:8562:x1874678300840064:12345-0@lo:502:llog_process_th.0 Request processed in 276us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832704.758459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787832704.758554:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8562:1874678300840064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787832704.758669:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832704.758692:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832704.758695:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787832704.758834:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3543878800 00000020:00000080:3.0:1787832704.758837:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787832704.758959:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8562:1874678300840192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832704.759000:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832704.759042:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832704.759962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840192 00000100:00100000:1.0:1787832704.759970:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840192 00000100:00100000:1.0:1787832704.760022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787832704.760033:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:8562:x1874678300840192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832704.760253:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:8562:x1874678300840192:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832704.760262:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787832704.760774:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:8562:1874678300840192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832704.760808:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832704.760815:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832704.760817:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787832704.760823:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787832704.762159:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787832704.762192:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787832704.762204:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832704.762217:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832705.744907:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832706.764039:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832707.793833:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832707.855668:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300840320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832707.855772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832707.855866:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840320 00000100:00100000:1.0:1787832707.855874:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840320 00000100:00100000:1.0:1787832707.855932:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787832707.855941:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300840320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832707.855976:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832707.856021:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300840320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832707.856027:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787832707.856050:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787832707.856081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb58f00 x1874678300840320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832707.856100:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300840320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832708.363974:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300840448:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364121:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300840960:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364184:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787832708.364191:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300840576:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364234:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300841088:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364288:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300840704:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364329:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832708.364335:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300840832:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832708.364400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840960 00000100:00100000:1.0:1787832708.364408:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840960 00000100:00100000:1.0:1787832708.364454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840576 00000100:00100000:1.0:1787832708.364457:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840576 00000100:00100000:1.0:1787832708.364469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840704 00000100:00100000:1.0:1787832708.364471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840704 00000100:00100000:1.0:1787832708.364489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787832708.364497:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300840960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364560:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300840960:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832708.364567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787832708.364587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787832708.364593:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300840576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364618:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300840576:12345-0@lo:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832708.364624:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787832708.364635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787832708.364640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300840704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364669:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300840704:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832708.364675:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787832708.364693:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841088 00000100:00100000:1.0:1787832708.364696:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841088 00000100:00100000:1.0:1787832708.364744:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840832 00000100:00100000:1.0:1787832708.364747:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840832 00000100:00100000:1.0:1787832708.364767:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787832708.364774:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300841088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364811:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300841088:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832708.364817:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787832708.364827:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787832708.364833:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364857:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300840832:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832708.364863:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787832708.364886:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787832708.364890:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787832708.364925:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b04b40 x1874678300840832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832708.364940:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300840832:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364952:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300840704:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.364983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300840576:0@lo:400:kworker.0 00010000:00080000:1.0:1787832708.364993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b04000 x1874678300841088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832708.364999:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300841088:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.365009:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300840960:0@lo:400:kworker.0 00000100:00100000:0.0:1787832708.365190:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300840448 00000100:00100000:0.0:1787832708.365195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300840448 00000100:00100000:0.0:1787832708.365232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787832708.365238:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300840448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832708.365280:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300840448:12345-0@lo:400:kworker.0 Request processed in 42us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832708.365286:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787832708.365324:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300840448:0@lo:400:kworker.0 00000100:00100000:1.0:1787832708.366491:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832708.366525:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300841216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832708.366580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832708.367777:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841216 00000100:00100000:2.0:1787832708.367788:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841216 00000100:00100000:2.0:1787832708.367845:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787832708.367855:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300841216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832708.367892:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832708.367956:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300841216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832708.367963:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787832708.368016:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565c70780 x1874678300841216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832708.368038:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300841216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787832708.813770:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832709.633053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832709.633121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832709.633319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832709.633354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832709.633388:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984448 00000100:00100000:1.0:1787832709.633401:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984448 00000100:00100000:1.0:1787832709.633476:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984576 00000100:00100000:1.0:1787832709.633479:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984576 00000100:00100000:1.0:1787832709.633525:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832709.633537:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678282984448:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832709.633637:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678282984448:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 103us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832709.633646:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832709.633665:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787832709.633672:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678282984576:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832709.633696:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678282984576:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832709.633735:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787832709.633758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984320 00000100:00100000:1.0:1787832709.633762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984320 00000100:00100000:1.0:1787832709.633798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:1.0:1787832709.633806:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282984320:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832709.633849:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282984320:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832709.633856:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00080000:1.0:1787832709.633878:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832709.633883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787832709.633893:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832709.643456:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984192 00000100:00100000:2.0:1787832709.643481:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984192 00000100:00100000:2.0:1787832709.643589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:2.0:1787832709.643603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282984192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832709.643746:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282984192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 147us (10710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832709.643754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00010000:00010000:2.0:1787832709.837936:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832710.860905:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832711.884071:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832712.084897:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787832712.909090:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832712.972665:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300841344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832712.972788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832712.973195:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841344 00000100:00100000:1.0:1787832712.973204:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841344 00000100:00100000:1.0:1787832712.973275:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787832712.973285:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300841344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832712.973320:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832712.973365:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300841344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832712.973372:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787832712.975388:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832712.975455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb58b40 x1874678300841344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832712.975480:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300841344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832713.484419:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300841600:0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.484503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832713.484576:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787832713.484582:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300841472:0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.484612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832713.484640:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300841984:0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.484667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832713.484697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841472 00000100:00100000:1.0:1787832713.484733:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841472 00000100:00100000:1.0:1787832713.484787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787832713.484795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300841472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.484842:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300841472:12345-0@lo:400:kworker.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832713.484850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787832713.484880:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841984 00000100:00100000:1.0:1787832713.484884:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841984 00000100:00100000:1.0:1787832713.484917:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787832713.484924:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300841984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.484964:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300841984:12345-0@lo:400:kworker.0 Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832713.484971:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787832713.485002:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300841472:0@lo:400:kworker.0 00010000:00080000:1.0:1787832713.485015:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f692c0 x1874678300841984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832713.485025:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300841984:0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485547:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300841856:0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832713.485610:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832713.485627:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300841728:0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787832713.485681:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832713.485692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841600 00000100:00100000:2.0:1787832713.485697:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841600 00000100:00100000:2.0:1787832713.485737:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841856 00000100:00100000:2.0:1787832713.485740:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841856 00000100:00100000:2.0:1787832713.485760:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300841728 00000100:00100000:2.0:1787832713.485762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300841728 00000100:00100000:2.0:1787832713.485777:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832713.485783:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300841600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485825:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300841600:12345-0@lo:400:kworker.0 Request processed in 42us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832713.485832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832713.485845:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787832713.485851:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485895:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300841856:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832713.485901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787832713.485927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787832713.485934:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.485963:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300841728:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832713.485968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787832713.485984:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832713.485994:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300842112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832713.486020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832713.486056:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300841600:0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.486082:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300841728:0@lo:400:kworker.0 00000100:00100000:2.0:1787832713.486092:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300841856:0@lo:400:kworker.0 00000100:00100000:1.0:1787832713.487628:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842112 00000100:00100000:1.0:1787832713.487638:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842112 00000100:00100000:1.0:1787832713.487685:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832713.487695:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300842112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832713.487976:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832713.488056:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300842112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832713.488063:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787832713.488071:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f692c0 x1874678300842112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832713.488090:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300842112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787832713.933804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832714.762089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832714.762147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832714.762188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832714.762299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984704 00000100:00100000:0.0:1787832714.762312:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984704 00000100:00100000:0.0:1787832714.762372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:0.0:1787832714.762384:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282984704:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832714.762486:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984960 00000100:00100000:0.0:1787832714.762498:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282984704:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832714.762504:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984960 00000100:00100000:0.0:1787832714.762511:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:2.0:1787832714.762617:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787832714.762635:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2351:x1874678282984960:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1787832714.762677:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bf3 00000100:00080000:2.0:1787832714.762742:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357bb25000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787832714.762750:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787832714.762777:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787832714.762792:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787832714.763156:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+2:2351:x1874678282984960:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 527us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832714.763165:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787832714.763372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282984832 00000100:00100000:3.0:1787832714.763380:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282984832 00000100:00100000:3.0:1787832714.763455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787832714.763470:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282984832:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832714.763519:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282984832:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 52us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832714.763526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00080000:2.0:1787832714.764532:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832714.784923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832714.785030:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985088 00000100:00100000:2.0:1787832714.785039:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985088 00000100:00100000:2.0:1787832714.785112:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832714.785122:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2351:x1874678282985088:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:2.0:1787832714.785161:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bfa 00000100:00080000:2.0:1787832714.785170:0:8408:0:(import.c:65:import_set_state_nolock()) ffff8c357bb27800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787832714.785214:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787832714.785691:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+2:2351:x1874678282985088:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 570us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832714.785732:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00080000:0.0:1787832714.786038:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787832714.786289:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832714.957928:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832715.984408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832717.004008:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787832717.827244:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing yml_node 00010000:00010000:1.0:1787832718.029952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832718.101726:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300842240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832718.101805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832718.101898:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842240 00000100:00100000:2.0:1787832718.101906:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842240 00000100:00100000:2.0:1787832718.101961:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832718.101972:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300842240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787832718.102010:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832718.102059:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300842240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832718.102066:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787832718.102088:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832718.102122:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f69680 x1874678300842240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832718.102141:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300842240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832718.606005:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300842368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832718.606080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832718.606168:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842368 00000100:00100000:1.0:1787832718.606176:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842368 00000100:00100000:1.0:1787832718.606243:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832718.606253:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300842368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832718.606288:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832718.606347:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300842368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832718.606355:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787832718.606376:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787832718.606408:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6a940 x1874678300842368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832718.606425:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300842368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832718.609230:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300842624:0@lo:400:kworker.0 00000100:00100000:3.0:1787832718.609294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832718.609346:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832718.609353:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300842496:0@lo:400:kworker.0 00000100:00100000:3.0:1787832718.609382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832718.609416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842624 00000100:00100000:3.0:1787832718.609423:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842624 00000100:00100000:3.0:1787832718.609467:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787832718.609475:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300842624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832718.609527:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300842624:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832718.609534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787832718.609557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842496 00000100:00100000:3.0:1787832718.609561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842496 00000100:00100000:3.0:1787832718.609586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787832718.609592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300842496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832718.609620:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300842496:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832718.609626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787832718.609670:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300842496:0@lo:400:kworker.0 00000100:00100000:3.0:1787832718.609683:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300842624:0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.617820:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300842752:0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.617904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832718.617945:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832718.617955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300842880:0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.617978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832718.618128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842752 00000100:00100000:1.0:1787832718.618136:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842752 00000100:00100000:1.0:1787832718.618188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300842880 00000100:00100000:1.0:1787832718.618191:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300842880 00000100:00100000:1.0:1787832718.618212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787832718.618221:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300842752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.618277:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300842752:12345-0@lo:400:kworker.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832718.618284:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787832718.618302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787832718.618308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300842880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.618366:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300842880:12345-0@lo:400:kworker.0 Request processed in 58us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832718.618373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787832718.618391:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832718.618418:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300842880:0@lo:400:kworker.0 00000100:00100000:1.0:1787832718.618428:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300842752:0@lo:400:kworker.0 00010000:00010000:0.0:1787832719.056013:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787832719.748218:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832719.748228:0:6720:0:(genops.c:885:class_export_put()) final put ffff8c357bb23800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832719.748260:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357bb23800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-OST0000 00000020:00000080:1.0:1787832719.748309:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357bb25000 for lustre-OST0000 00000001:00100000:1.0:1787832719.750020:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832719.750029:0:7648:0:(genops.c:885:class_export_put()) final put ffff8c357bb24800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:0.0:1787832719.750138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357bb24800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-OST0001 00000020:00000080:0.0:1787832719.750186:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357bb27800 for lustre-OST0001 00000100:00100000:0.0:1787832719.896906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832719.896969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832719.897039:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985344 00000100:00100000:3.0:1787832719.897049:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985344 00000100:00100000:3.0:1787832719.897125:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787832719.897136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282985344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832719.897213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282985344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832719.897234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00080000:0.0:1787832719.897421:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832719.898154:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985216 00000100:00100000:1.0:1787832719.898161:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985216 00000100:00100000:1.0:1787832719.898200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:1.0:1787832719.898207:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282985216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832719.898249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282985216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 42us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832719.898255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:2.0:1787832720.075958:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832721.099897:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832722.139810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832723.151698:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832723.212241:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300843008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832723.212325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832723.212441:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843008 00000100:00100000:1.0:1787832723.212448:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843008 00000100:00100000:1.0:1787832723.212515:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787832723.212524:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300843008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832723.212558:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832723.212614:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300843008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832723.212621:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787832723.212892:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787832723.212926:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f69e00 x1874678300843008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832723.212945:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300843008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832723.728363:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300843520:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832723.728495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787832723.728502:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300843136:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832723.728547:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300843648:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832723.728587:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300843264:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832723.728620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832723.728625:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300843392:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832723.728673:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843520 00000100:00100000:3.0:1787832723.728679:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843520 00000100:00100000:3.0:1787832723.728739:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843264 00000100:00100000:3.0:1787832723.728741:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843264 00000100:00100000:3.0:1787832723.728751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843392 00000100:00100000:3.0:1787832723.728753:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843392 00000100:00100000:3.0:1787832723.728770:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787832723.728779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300843520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728827:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300843520:12345-0@lo:400:kworker.0 Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832723.728833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787832723.728849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787832723.728853:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300843264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728895:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300843264:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832723.728901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787832723.728915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832723.728920:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300843392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.728941:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300843392:12345-0@lo:400:kworker.0 Request processed in 22us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832723.728946:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832723.728961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843136 00000100:00100000:3.0:1787832723.728964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843136 00000100:00100000:3.0:1787832723.729123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787832723.729131:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300843136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.729161:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300843136:12345-0@lo:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832723.729166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787832723.729193:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832723.729354:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300843392:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.729365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300843264:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.730184:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300843136:0@lo:400:kworker.0 00000100:00100000:3.0:1787832723.730198:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300843520:0@lo:400:kworker.0 00000100:00100000:2.0:1787832723.730635:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843648 00000100:00100000:2.0:1787832723.730642:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843648 00000100:00100000:2.0:1787832723.730690:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787832723.730718:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300843648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832723.730784:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300843648:12345-0@lo:400:kworker.0 Request processed in 86us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832723.730791:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787832723.730811:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787832723.730837:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ae580 x1874678300843648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832723.730849:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300843648:0@lo:400:kworker.0 00000100:00100000:1.0:1787832723.740653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300843776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832723.740751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832723.740856:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843776 00000100:00100000:1.0:1787832723.740864:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843776 00000100:00100000:1.0:1787832723.740911:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832723.740920:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300843776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832723.740956:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832723.741017:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300843776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832723.741024:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787832723.741092:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6b480 x1874678300843776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832723.741111:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300843776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787832724.173483:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787832724.945399:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.60 00000100:00100000:0.0:1787832724.998489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832724.998559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832724.998941:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985472 00000100:00100000:3.0:1787832724.998952:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985472 00000100:00100000:3.0:1787832724.999003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:3.0:1787832724.999013:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282985472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832724.999097:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282985472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 85us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832724.999106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:3.0:1787832724.999141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985600 00000100:00100000:3.0:1787832724.999145:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985600 00000100:00100000:3.0:1787832724.999183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1787832724.999190:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282985600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832724.999236:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282985600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832724.999243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00080000:3.0:1787832725.000091:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787832725.209863:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832726.224537:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832727.246619:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832728.268028:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832728.306981:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.60 00000100:00100000:3.0:1787832728.333367:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300843904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832728.333483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832728.334593:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300843904 00000100:00100000:1.0:1787832728.334606:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300843904 00000100:00080000:3.0:1787832728.334818:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832728.336794:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832728.336817:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300843904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832728.336924:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832728.337036:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300843904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (3552us total) trans 0 rc 0/0 00010000:00080000:2.0:1787832728.337219:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6b480 x1874678300843904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832728.337248:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300843904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832728.340458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787832728.843914:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832728.843947:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300844032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832728.844046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832728.844183:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844032 00000100:00100000:1.0:1787832728.844194:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844032 00000100:00080000:0.0:1787832728.844794:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832728.844864:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787832728.844877:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300844032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832728.844932:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832728.845016:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300844032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832728.845026:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787832728.845118:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6a580 x1874678300844032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832728.845145:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300844032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832728.847955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300844288:0@lo:400:kworker.0 00000100:00100000:1.0:1787832728.848060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832728.848109:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832728.848115:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300844416:0@lo:400:kworker.0 00000100:00100000:1.0:1787832728.848142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832728.848244:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300844160:0@lo:400:kworker.0 00000100:00100000:0.0:1787832728.848286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832728.848329:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832728.848335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300844544:0@lo:400:kworker.0 00000100:00100000:0.0:1787832728.848359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832728.848538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844160 00000100:00100000:1.0:1787832728.848550:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844160 00000100:00100000:1.0:1787832728.848626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787832728.848638:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300844160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832728.848728:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300844160:12345-0@lo:400:kworker.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832728.848737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787832728.848794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300844160:0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844288 00000100:00100000:3.0:1787832728.849006:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844288 00000100:00100000:3.0:1787832728.849032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844416 00000100:00100000:3.0:1787832728.849035:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844416 00000100:00100000:3.0:1787832728.849059:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844544 00000100:00100000:3.0:1787832728.849062:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844544 00000100:00100000:3.0:1787832728.849079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787832728.849086:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300844288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849139:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300844288:12345-0@lo:400:kworker.0 Request processed in 53us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832728.849146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787832728.849172:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787832728.849201:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300844416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300844416:12345-0@lo:400:kworker.0 Request processed in 48us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832728.849255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787832728.849267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787832728.849273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300844544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849307:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300844544:12345-0@lo:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832728.849313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787832728.849338:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832728.849364:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300844416:0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300844288:0@lo:400:kworker.0 00000100:00100000:3.0:1787832728.849406:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300844544:0@lo:400:kworker.0 00010000:00010000:1.0:1787832729.295621:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832730.108962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832730.109083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832730.109191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985856 00000100:00100000:3.0:1787832730.109206:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985856 00000100:00100000:3.0:1787832730.109311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787832730.109326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282985856:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832730.109469:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282985856:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 147us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832730.109478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00080000:1.0:1787832730.109729:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832730.110734:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985728 00000100:00100000:0.0:1787832730.110746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985728 00000100:00100000:0.0:1787832730.110818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1787832730.110830:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282985728:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832730.110909:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282985728:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 81us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832730.111599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00010000:00010000:1.0:1787832730.317252:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832731.342392:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787832731.655544:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.60 00010000:00010000:1.0:1787832732.365631:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832733.388391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787832733.420913:0:9493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 08:12:12 EDT 2026 00000100:00100000:1.0:1787832733.455442:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832733.455472:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300844672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832733.455571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832733.455652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844672 00000100:00100000:1.0:1787832733.455660:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844672 00000100:00100000:1.0:1787832733.455752:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787832733.455764:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300844672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832733.455809:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832733.455863:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300844672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832733.455872:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787832733.455897:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787832733.455935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6b480 x1874678300844672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832733.455958:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300844672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832733.965229:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300844800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832733.965335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832733.965743:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844800 00000100:00100000:1.0:1787832733.965754:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844800 00000100:00100000:1.0:1787832733.965828:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832733.965839:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300844800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832733.965886:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832733.965946:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300844800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832733.965955:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787832733.966018:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f692c0 x1874678300844800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832733.966075:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300844800:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787832733.966376:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832733.969968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300844928:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832733.970144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832733.970150:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300845312:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832733.970221:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832733.970377:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832733.970385:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832733.970453:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845312 00000100:00100000:2.0:1787832733.970461:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845312 00000100:00100000:2.0:1787832733.970517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845184 00000100:00100000:2.0:1787832733.970520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845184 00000100:00100000:2.0:1787832733.970535:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845056 00000100:00100000:2.0:1787832733.970537:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845056 00000100:00100000:2.0:1787832733.970552:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787832733.970561:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300845312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300845312:12345-0@lo:400:kworker.0 Request processed in 58us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832733.970627:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787832733.970645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787832733.970651:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300845184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970680:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300845184:12345-0@lo:400:kworker.0 Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832733.970686:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787832733.970696:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787832733.970726:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970754:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300845056:12345-0@lo:400:kworker.0 Request processed in 52us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832733.970761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787832733.970787:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832733.970824:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970835:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787832733.970871:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300845312:0@lo:400:kworker.0 00000100:00100000:0.0:1787832733.972343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300844928 00000100:00100000:0.0:1787832733.972356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300844928 00000100:00100000:0.0:1787832733.972425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787832733.972435:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300844928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832733.972531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300844928:12345-0@lo:400:kworker.0 Request processed in 98us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832733.972539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787832733.972753:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300844928:0@lo:400:kworker.0 00010000:00010000:2.0:1787832734.416028:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832735.233178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832735.233248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832735.233303:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986112 00000100:00100000:3.0:1787832735.233318:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986112 00000100:00100000:3.0:1787832735.233419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787832735.233434:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282986112:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832735.233552:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282986112:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832735.233560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00080000:2.0:1787832735.234875:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832735.234991:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282985984 00000100:00100000:0.0:1787832735.235003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282985984 00000100:00100000:0.0:1787832735.235069:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:0.0:1787832735.235080:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282985984:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832735.235168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282985984:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 90us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832735.235176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00010000:00010000:1.0:1787832735.442112:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832736.459968:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832737.483900:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832738.528531:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832738.572013:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832738.572043:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300845440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832738.572131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832738.572435:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845440 00000100:00100000:1.0:1787832738.572445:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845440 00000100:00100000:1.0:1787832738.572513:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832738.572523:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300845440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832738.572559:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832738.572610:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300845440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832738.572617:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787832738.572654:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6b480 x1874678300845440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832738.572673:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300845440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787832738.573017:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832739.085448:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832739.085475:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832739.085572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832739.085643:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845568 00000100:00100000:3.0:1787832739.085651:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845568 00000100:00100000:3.0:1787832739.085750:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787832739.085774:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300845568:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787832739.085797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787832739.086912:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832739.087004:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300845568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1231us (1430us total) trans 0 rc 0/0 00010000:00080000:0.0:1787832739.087099:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b2ada40 x1874678300845568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832739.087122:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832739.090791:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300845824:0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.090863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832739.090905:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832739.090911:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300845952:0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.090934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832739.090990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845824 00000100:00100000:0.0:1787832739.090997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845824 00000100:00100000:0.0:1787832739.091042:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845952 00000100:00100000:0.0:1787832739.091045:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845952 00000100:00100000:0.0:1787832739.091072:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787832739.091080:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300845824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.091147:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300845824:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832739.091154:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787832739.091171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787832739.091177:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300845952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.091202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300845952:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832739.091207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787832739.091228:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832739.091254:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300845952:0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.091264:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300845824:0@lo:400:kworker.0 00000100:00100000:2.0:1787832739.095045:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300845696:0@lo:400:kworker.0 00000100:00100000:2.0:1787832739.095158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832739.095227:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300846208:0@lo:400:kworker.0 00000100:00100000:2.0:1787832739.095263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832739.095297:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832739.095305:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300846080:0@lo:400:kworker.0 00000100:00100000:2.0:1787832739.095330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832739.095719:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300845696 00000100:00100000:0.0:1787832739.095727:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300845696 00000100:00100000:0.0:1787832739.095776:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787832739.095787:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300845696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.095852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300845696:12345-0@lo:400:kworker.0 Request processed in 67us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832739.095859:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787832739.095890:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846080 00000100:00100000:0.0:1787832739.095893:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846080 00000100:00100000:0.0:1787832739.095920:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787832739.095927:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300846080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.095982:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300846080:12345-0@lo:400:kworker.0 Request processed in 34us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832739.095989:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787832739.096039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846208 00000100:00100000:0.0:1787832739.096042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846208 00000100:00100000:0.0:1787832739.096224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787832739.096233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300846208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.096268:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560352580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300846208:12345-0@lo:400:kworker.0 Request processed in 37us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832739.096274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787832739.096314:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b07c00 x1874678300846080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832739.096328:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300846080:0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.096338:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300845696:0@lo:400:kworker.0 00000100:00100000:0.0:1787832739.096348:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300846208:0@lo:400:kworker.0 00000100:00080000:2.0:1787832739.096695:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832739.109911:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787832739.533535:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832740.351296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832740.351347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832740.351431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986368 00000100:00100000:1.0:1787832740.351441:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986368 00000100:00100000:1.0:1787832740.351520:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1787832740.351531:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282986368:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832740.351620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282986368:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832740.351628:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1787832740.351799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986240 00000100:00100000:3.0:1787832740.351803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986240 00000100:00100000:3.0:1787832740.351837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:3.0:1787832740.351844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282986240:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832740.351872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2352:x1874678282986240:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832740.351878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00080000:2.0:1787832740.352021:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787832740.556327:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832741.579972:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832742.603863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832743.640634:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832743.700948:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300846336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832743.701061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832743.701149:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846336 00000100:00100000:1.0:1787832743.701160:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846336 00000100:00100000:1.0:1787832743.703204:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787832743.703221:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300846336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832743.703273:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832743.703385:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300846336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832743.703403:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787832743.704182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f6a580 x1874678300846336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832743.704215:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300846336:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787832743.714815:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832744.207649:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300846464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832744.207752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832744.207835:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846464 00000100:00100000:0.0:1787832744.207844:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846464 00000100:00100000:0.0:1787832744.207929:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787832744.207940:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300846464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832744.207978:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832744.208205:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300846464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 266us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832744.208213:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787832744.208240:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832744.208344:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300846592:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.208381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832744.208424:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300847104:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.208582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832744.208608:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832744.208616:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300846720:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.208643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832744.208676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846592 00000100:00100000:0.0:1787832744.208681:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846592 00000100:00100000:0.0:1787832744.208748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787832744.208758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300846592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.208796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300846592:12345-0@lo:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832744.208803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787832744.208830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847104 00000100:00100000:0.0:1787832744.208834:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847104 00000100:00100000:0.0:1787832744.208870:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846720 00000100:00100000:0.0:1787832744.208874:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846720 00000100:00100000:0.0:1787832744.208913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787832744.208922:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300847104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.208957:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300847104:12345-0@lo:400:kworker.0 Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832744.208963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787832744.208975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787832744.208981:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300846720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.209007:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300846720:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832744.209012:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787832744.209571:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300846848:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.209626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832744.209659:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832744.209660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846848 00000100:00100000:0.0:1787832744.209669:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300846976:0@lo:400:kworker.0 00000100:00100000:1.0:1787832744.209674:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846848 00000100:00100000:0.0:1787832744.209754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787832744.209788:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832744.209816:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300846720:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.209827:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300846592:0@lo:400:kworker.0 00000100:00100000:0.0:1787832744.209839:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300847104:0@lo:400:kworker.0 00000100:00100000:2.0:1787832744.209869:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300846976 00000100:00100000:2.0:1787832744.209876:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300846976 00000100:00100000:2.0:1787832744.209950:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832744.209961:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300846976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832744.210080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787832744.210088:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300846848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832744.210166:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300846848:12345-0@lo:400:kworker.0 Request processed in 78us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832744.210175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787832744.210240:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300846848:0@lo:400:kworker.0 00000100:00100000:2.0:1787832744.210283:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300846976:12345-0@lo:400:kworker.0 Request processed in 298us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832744.210301:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787832744.210345:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35464ffc00 x1874678300846976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832744.210356:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300846976:0@lo:400:kworker.0 00010000:00080000:3.0:1787832744.210740:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35464fc780 x1874678300846464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832744.210759:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300846464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787832744.651849:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832745.472653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832745.472693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832745.472746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986496 00000100:00100000:1.0:1787832745.472757:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986496 00000100:00100000:1.0:1787832745.472807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:1.0:1787832745.472817:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282986496:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832745.473324:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986624 00000100:00100000:0.0:1787832745.473329:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986624 00000100:00100000:0.0:1787832745.473368:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1787832745.473375:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282986624:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832745.473509:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2354:x1874678282986496:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 693us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832745.473518:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00080000:1.0:1787832745.473984:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832745.474143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282986624:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 768us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832745.474152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00010000:00010000:3.0:1787832745.677893:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832746.701525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832747.724469:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832748.748188:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832748.814248:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300847232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832748.814323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832748.814681:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847232 00000100:00100000:1.0:1787832748.814696:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847232 00000100:00100000:1.0:1787832748.814796:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787832748.814814:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300847232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832748.814849:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832748.814895:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300847232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832748.814902:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787832748.814971:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832748.815002:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3542f692c0 x1874678300847232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832748.815020:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300847232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832749.331791:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35591930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300847616:0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.331804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300847488:0@lo:400:kworker.0 00000100:00100000:1.0:1787832749.334576:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300847360:0@lo:400:kworker.0 00000100:00100000:0.0:1787832749.337186:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300847744:0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.343813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832749.343912:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847488 00000100:00100000:2.0:1787832749.343920:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847488 00000100:00100000:2.0:1787832749.343977:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787832749.343987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.344049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300847488:12345-0@lo:400:kworker.0 Request processed in 64us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832749.344055:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787832749.344125:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300847488:0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.344138:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300848000:0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.344173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832749.344198:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848000 00000100:00100000:2.0:1787832749.344201:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848000 00000100:00100000:2.0:1787832749.344238:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787832749.344244:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300848000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.344279:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300848000:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832749.346146:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787832749.346188:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787832749.346233:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b5892c0 x1874678300848000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832749.346247:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b5892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300848000:0@lo:400:kworker.0 00000100:00100000:3.0:1787832749.354482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832749.359528:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847616 00000100:00100000:2.0:1787832749.359551:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847616 00000100:00100000:2.0:1787832749.359670:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787832749.359686:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300847616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.359877:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b588f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300847616:12345-0@lo:400:kworker.0 Request processed in 196us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832749.359885:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787832749.360000:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35591930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300847616:0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.360045:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300848128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832749.360092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832749.360125:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848128 00000100:00100000:2.0:1787832749.360129:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848128 00000100:00100000:2.0:1787832749.360159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787832749.360165:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300848128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832749.360200:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832749.360231:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300848128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832749.360236:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787832749.360266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565b04000 x1874678300848128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832749.360318:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300848128:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787832749.361366:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832749.362222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832749.362300:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300847872:0@lo:400:kworker.0 00000100:00100000:1.0:1787832749.362343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832749.362822:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847872 00000100:00100000:2.0:1787832749.362834:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847872 00000100:00100000:3.0:1787832749.363152:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847360 00000100:00100000:3.0:1787832749.363162:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847360 00000100:00100000:3.0:1787832749.363210:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787832749.363219:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300847360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832749.363291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787832749.363304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300847872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832749.363307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300847360:12345-0@lo:400:kworker.0 Request processed in 71us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832749.363322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787832749.363392:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300847872:12345-0@lo:400:kworker.0 Request processed in 90us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832749.363403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787832749.363632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787832749.363809:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832749.363840:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300847360:0@lo:400:kworker.0 00000100:00100000:1.0:1787832749.363856:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300847872:0@lo:400:kworker.0 00000100:00100000:3.0:1787832749.364020:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300847744 00000100:00100000:3.0:1787832749.364024:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300847744 00000100:00100000:3.0:1787832749.364058:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787832749.364066:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300847744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832749.364118:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300847744:12345-0@lo:400:kworker.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832749.364125:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787832749.364609:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c354b718f00 x1874678300847744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832749.364621:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300847744:0@lo:400:kworker.0 00010000:00010000:3.0:1787832749.774909:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832750.591213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832750.591310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832750.591913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986880 00000100:00100000:3.0:1787832750.591926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986880 00000100:00100000:3.0:1787832750.592196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1787832750.592210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282986880:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832750.592318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282986880:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 112us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832750.592328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:0.0:1787832750.592738:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282986752 00000100:00100000:0.0:1787832750.592745:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282986752 00000100:00100000:0.0:1787832750.592812:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:0.0:1787832750.592821:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282986752:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832750.592870:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2353:x1874678282986752:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 51us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832750.592878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00080000:1.0:1787832750.594150:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832750.799178:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787832750.925324:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:12:29 (1787832749) === 00000100:00100000:3.0:1787832751.350559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832751.350750:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987008 00000100:00100000:1.0:1787832751.350769:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987008 00000100:00100000:1.0:1787832751.350820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:1.0:1787832751.350829:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:8126:x1874678282987008:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787832751.350848:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832751.350868:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41800/0x72bd9178b14b6cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b70667f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832751.350911:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41800/0x72bd9178b14b6cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70667f expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832751.350922:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41800/0x72bd9178b14b6cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70667f expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832751.350932:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41800, rc 0) 00000100:00100000:1.0:1787832751.351006:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987008:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 178us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832751.351014:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:1.0:1787832751.358770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.358870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987136 00000100:00100000:0.0:1787832751.358881:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987136 00000100:00100000:0.0:1787832751.358937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:0.0:1787832751.358958:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987136:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787832751.359280:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987136:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 324us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832751.359289:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:2.0:1787832751.365156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.366125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987264 00000100:00100000:0.0:1787832751.366139:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987264 00000100:00100000:0.0:1787832751.366215:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:0.0:1787832751.366227:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987264:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787832751.366475:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987264:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 250us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832751.366484:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:3.0:1787832751.369891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832751.370054:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987392 00000100:00100000:1.0:1787832751.370064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987392 00000100:00100000:1.0:1787832751.370118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:1.0:1787832751.370126:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8130:x1874678282987392:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787832751.370394:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8130:x1874678282987392:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 267us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832751.370412:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:1.0:1787832751.388893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832751.389066:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987520 00000100:00100000:3.0:1787832751.389076:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987520 00000100:00100000:3.0:1787832751.389133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787832751.389143:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8130:x1874678282987520:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832751.389433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8130:x1874678282987520:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 289us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832751.389441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:2.0:1787832751.401035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.401154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987648 00000100:00100000:0.0:1787832751.401164:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987648 00000100:00100000:0.0:1787832751.401226:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:0.0:1787832751.401237:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:8126:x1874678282987648:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787832751.401255:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832751.401274:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031400/0x72bd9178b14b6cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066a9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832751.401318:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031400/0x72bd9178b14b6cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066a9 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832751.401330:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031400/0x72bd9178b14b6cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066a9 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832751.401340:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031400, rc 0) 00000100:00100000:0.0:1787832751.401399:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:8126:x1874678282987648:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832751.401408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:0.0:1787832751.404200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832751.404314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987776 00000100:00100000:1.0:1787832751.404324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987776 00000100:00100000:1.0:1787832751.404380:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:1.0:1787832751.404390:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:8126:x1874678282987776:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787832751.404420:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787832751.404444:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787832751.404448:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787832751.404452:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787832751.404454:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787832751.407426:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:8126:x1874678282987776:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 3025us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.407443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:2.0:1787832751.413655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832751.413871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282987904 00000100:00100000:3.0:1787832751.414135:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282987904 00000100:00100000:3.0:1787832751.414198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:3.0:1787832751.414209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:8126:x1874678282987904:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787832751.414226:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832751.414245:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066b0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832751.414273:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832751.414285:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832751.414308:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832751.414371:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8126:x1874678282987904:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 164us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832751.414378:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1787832751.426590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832751.426909:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988032 00000100:00100000:2.0:1787832751.426919:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988032 00000100:00100000:2.0:1787832751.427263:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:2.0:1787832751.427274:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8126:x1874678282988032:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787832751.427683:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8126:x1874678282988032:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 410us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.427693:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:1.0:1787832751.433415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.433993:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988160 00000100:00100000:0.0:1787832751.434004:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988160 00000100:00100000:0.0:1787832751.434063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:0.0:1787832751.434073:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8126:x1874678282988160:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787832751.434312:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8126:x1874678282988160:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 240us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832751.434320:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:1.0:1787832751.443153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832751.446977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988288 00000100:00100000:3.0:1787832751.446994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988288 00000100:00100000:2.0:1787832751.447257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:2.0:1787832751.447267:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8133:x1874678282988288:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787832751.447725:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8133:x1874678282988288:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 435us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.447740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:3.0:1787832751.449783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832751.450270:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988416 00000100:00100000:2.0:1787832751.450279:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988416 00000100:00100000:2.0:1787832751.450331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:2.0:1787832751.450341:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8133:x1874678282988416:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787832751.451207:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:8133:x1874678282988416:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 863us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.451217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:1.0:1787832751.462019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832751.462059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832751.462185:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988544 00000100:00100000:2.0:1787832751.462195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988544 00000100:00100000:2.0:1787832751.462243:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988928 00000100:00100000:2.0:1787832751.462246:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988928 00000100:00100000:2.0:1787832751.462274:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1787832751.462284:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282988928:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832751.462362:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282988928:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.462370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1787832751.462386:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787832751.462390:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1874678282988544:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787832751.462412:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2f665ede-f2c4-41f1-a7ce-59cc3155785a@192.168.201.34@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787832751.462448:0:5843:0:(genops.c:1385:class_connect()) connect: client 2f665ede-f2c4-41f1-a7ce-59cc3155785a, cookie 0x72bd9178b14b6cd3 00000004:00100000:2.0:1787832751.462493:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787832751.462797:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8c357c691800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832751.463449:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b718f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2351:x1874678282988544:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 1053us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.463473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787832751.471128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832751.471177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832751.472796:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988672 00000100:00100000:3.0:1787832751.472807:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988672 00000100:00100000:1.0:1787832751.473618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282988800 00000100:00100000:1.0:1787832751.473624:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282988800 00000100:00100000:1.0:1787832751.473647:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832751.473656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+7:0:x1874678282988672:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787832751.473727:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787832751.473837:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+7:0:x1874678282988672:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 180us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832751.473845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832751.473863:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787832751.473898:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282988800:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787832751.473912:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787832751.473935:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282988800:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 39us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832751.475370:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:1.0:1787832751.475402:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832751.494016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832751.494123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989056 00000100:00100000:2.0:1787832751.494134:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989056 00000100:00100000:2.0:1787832751.494197:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832751.494207:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282989056:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787832751.494303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282989056:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.494310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832751.503603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.503637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832751.503672:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832751.503969:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989184 00000100:00100000:2.0:1787832751.503979:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989184 00000100:00100000:2.0:1787832751.504023:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989312 00000100:00100000:2.0:1787832751.504026:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989312 00000100:00100000:2.0:1787832751.504049:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787832751.504057:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678282989184:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787832751.504091:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2f665ede-f2c4-41f1-a7ce-59cc3155785a@192.168.201.34@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787832751.504128:0:6695:0:(genops.c:1385:class_connect()) connect: client 2f665ede-f2c4-41f1-a7ce-59cc3155785a, cookie 0x72bd9178b14b6cda 00002000:00100000:2.0:1787832751.504141:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f665ede-f2c4-41f1-a7ce-59cc3155785a/ffff8c357c693800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787832751.504167:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787832751.504406:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787832751.504438:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c357c690000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832751.504520:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2351:x1874678282989184:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 462us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.504528:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787832751.504547:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832751.504552:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678282989312:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787832751.504908:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2f665ede-f2c4-41f1-a7ce-59cc3155785a@192.168.201.34@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787832751.504927:0:6695:0:(genops.c:1385:class_connect()) connect: client 2f665ede-f2c4-41f1-a7ce-59cc3155785a, cookie 0x72bd9178b14b6ce1 00002000:00100000:2.0:1787832751.504934:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f665ede-f2c4-41f1-a7ce-59cc3155785a/ffff8c357c696000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787832751.504962:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787832751.505097:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787832751.505115:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c357c695800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832751.505145:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2351:x1874678282989312:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 591us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832751.505154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787832751.505404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989440 00000100:00100000:1.0:1787832751.505410:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989440 00000100:00100000:1.0:1787832751.505456:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832751.505464:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282989440:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787832751.505931:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787832751.506067:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:8126:x1874678282989440:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 603us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832751.506075:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00010000:00010000:3.0:1787832751.822606:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832752.843897:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832753.868186:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832753.932849:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787832753.932872:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560351a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300848256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832753.932944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832753.933013:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848256 00000100:00100000:2.0:1787832753.933020:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848256 00000100:00100000:2.0:1787832753.933075:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787832753.933084:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300848256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787832753.933136:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832753.933181:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560352d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300848256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832753.933188:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787832753.933208:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787832753.933239:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560351a40 x1874678300848256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832753.933258:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560351a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300848256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832754.443923:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560351a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300848384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832754.443998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832754.444132:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848384 00000100:00100000:2.0:1787832754.444152:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848384 00000100:00100000:2.0:1787832754.444227:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787832754.444238:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300848384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832754.444273:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787832754.444471:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832754.444596:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300848384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 354us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832754.444609:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787832754.444616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560351a40 x1874678300848384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832754.444638:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560351a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300848384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832754.445142:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300848512:0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.445196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832754.445216:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300848640:0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.445240:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300849024:0@lo:400:kworker.0 00000100:00100000:1.0:1787832754.445269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832754.445281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848512 00000100:00100000:2.0:1787832754.445288:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848512 00000100:00100000:1.0:1787832754.445312:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787832754.445327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787832754.445336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300848512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832754.445347:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300848768:0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.445392:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300848512:12345-0@lo:400:kworker.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832754.445400:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787832754.445406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832754.445494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848640 00000100:00100000:1.0:1787832754.445500:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848640 00000100:00100000:2.0:1787832754.445511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848768 00000100:00100000:2.0:1787832754.445517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848768 00000100:00100000:1.0:1787832754.445559:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787832754.445568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787832754.445577:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.445595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300848768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832754.445632:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300848640:12345-0@lo:400:kworker.0 Request processed in 63us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832754.445640:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787832754.445672:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832754.445685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832754.445765:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300848512:0@lo:400:kworker.0 00000100:00100000:1.0:1787832754.445780:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832754.445787:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300848896:0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.445814:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300848768:12345-0@lo:400:kworker.0 Request processed in 231us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832754.445842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832754.445852:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787832754.445888:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849024 00000100:00100000:2.0:1787832754.445893:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849024 00000100:00100000:1.0:1787832754.445915:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300848768:0@lo:400:kworker.0 00000100:00100000:1.0:1787832754.445937:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300848640:0@lo:400:kworker.0 00000100:00080000:1.0:1787832754.446302:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832754.446333:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787832754.446401:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300849024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.454390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300849024:12345-0@lo:400:kworker.0 Request processed in 7975us (8688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832754.454407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787832754.454478:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300848896 00000100:00100000:2.0:1787832754.454489:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300848896 00000100:00100000:2.0:1787832754.454545:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787832754.454553:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300848896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832754.454630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300848896:12345-0@lo:400:kworker.0 Request processed in 79us (8799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832754.454636:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787832754.458958:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546494f00 x1874678300848896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832754.458983:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300848896:0@lo:400:kworker.0 00000100:00100000:3.0:1787832754.459008:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300849024:0@lo:400:kworker.0 00000001:00100000:3.0:1787832754.581634:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00010000:00010000:3.0:1787832754.895953:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787832755.524147:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000001:00100000:3.0:1787832755.613850:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00010000:00010000:3.0:1787832755.915901:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832756.731188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832756.731271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832756.731310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832756.731411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989568 00000100:00100000:1.0:1787832756.731411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989824 00000100:00100000:2.0:1787832756.731425:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989568 00000100:00100000:1.0:1787832756.731425:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989824 00000100:00100000:1.0:1787832756.731489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:2.0:1787832756.731490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:2.0:1787832756.731501:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678282989568:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832756.731501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282989824:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832756.731582:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282989824:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832756.731591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00080000:1.0:1787832756.731614:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832756.732044:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990080 00000100:00100000:0.0:1787832756.732050:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990080 00000100:00100000:0.0:1787832756.732088:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00080000:1.0:1787832756.732095:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832756.732096:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282990080:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832756.732201:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678282989568:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 702us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832756.732210:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:3.0:1787832756.732820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832756.732852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832756.733359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989696 00000100:00100000:2.0:1787832756.733366:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989696 00000100:00100000:2.0:1787832756.733413:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:2.0:1787832756.733422:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282989696:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832756.733471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282989696:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 50us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832756.733478:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:2.0:1787832756.733505:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282989952 00000100:00080000:1.0:1787832756.733505:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832756.733509:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282989952 00000100:00080000:1.0:1787832756.733526:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832756.733536:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1787832756.733544:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282989952:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832756.733570:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282989952:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 28us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832756.733577:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832756.734390:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282990080:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2291us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832756.734400:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00010000:00010000:1.0:1787832756.940204:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787832756.980678:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787832757.966994:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832758.991246:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832759.061993:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832759.062017:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300849152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832759.062084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832759.062177:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849152 00000100:00100000:1.0:1787832759.062185:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849152 00000100:00100000:1.0:1787832759.062259:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787832759.062270:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300849152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832759.062303:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787832759.062332:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832759.062353:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300849152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832759.062360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787832759.062369:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546496580 x1874678300849152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832759.062387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300849152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832759.571805:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300849280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832759.571894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832759.572075:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849280 00000100:00100000:1.0:1787832759.572083:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849280 00000100:00100000:1.0:1787832759.572135:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787832759.572145:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300849280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832759.572181:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832759.572226:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300849280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832759.572232:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787832759.572271:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546497840 x1874678300849280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832759.572290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300849280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787832759.573591:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832759.574113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300849408:0@lo:400:kworker.0 00000100:00100000:0.0:1787832759.574169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832759.574253:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832759.574259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300849536:0@lo:400:kworker.0 00000100:00100000:0.0:1787832759.574285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832759.574317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849408 00000100:00100000:0.0:1787832759.574322:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849408 00000100:00100000:0.0:1787832759.574361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787832759.574368:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300849408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832759.574409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300849408:12345-0@lo:400:kworker.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832759.574415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787832759.574461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849536 00000100:00100000:0.0:1787832759.574464:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849536 00000100:00100000:0.0:1787832759.574490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787832759.574730:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300849664:0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.574772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832759.574791:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832759.574798:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300849792:0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.574819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832759.574873:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300849408:0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.574902:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832759.574910:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787832759.575083:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849664 00000100:00100000:1.0:1787832759.575088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849664 00000100:00100000:1.0:1787832759.575114:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832759.575120:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849792 00000100:00100000:1.0:1787832759.575123:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849792 00000100:00100000:1.0:1787832759.575137:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832759.575144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787832759.575151:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300849664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.575190:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300849664:12345-0@lo:400:kworker.0 Request processed in 40us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832759.575197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787832759.575209:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832759.575216:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787832759.575222:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300849792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.575249:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300849792:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832759.575254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787832759.575281:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300849792:0@lo:400:kworker.0 00000100:00100000:1.0:1787832759.575292:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300849664:0@lo:400:kworker.0 00000100:00080000:1.0:1787832759.575417:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832759.576029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300849536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832759.576081:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300849536:12345-0@lo:400:kworker.0 Request processed in 1585us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832759.576089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787832759.576122:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300849536:0@lo:400:kworker.0 00010000:00010000:1.0:1787832760.011805:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832761.036349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832761.851846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832761.851943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832761.851976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832761.852014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832761.852091:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990720 00000100:00100000:0.0:1787832761.852103:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990720 00000100:00100000:0.0:1787832761.852174:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787832761.852185:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990720:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832761.852260:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990720:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832761.852267:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1787832761.852463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990464 00000100:00100000:1.0:1787832761.852469:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990464 00000100:00100000:1.0:1787832761.852513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990336 00000100:00100000:1.0:1787832761.852517:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990336 00000100:00100000:1.0:1787832761.852550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1787832761.852557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990464:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832761.852604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990464:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 47us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832761.852611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1787832761.852625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1787832761.852631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282990336:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832761.852657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282990336:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832761.852663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00080000:3.0:1787832761.852806:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787832761.852811:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832761.854360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832761.856405:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990592 00000100:00100000:1.0:1787832761.856419:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990592 00000100:00100000:1.0:1787832761.856518:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1787832761.856538:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990592:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832761.856634:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282990592:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832761.856653:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00080000:3.0:1787832761.857883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832761.862147:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990208 00000100:00100000:2.0:1787832761.862165:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990208 00000100:00100000:2.0:1787832761.862244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:2.0:1787832761.862254:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282990208:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832761.862359:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282990208:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 105us (10523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832761.862367:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 226 00010000:00010000:0.0:1787832762.061469:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832763.083998:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832764.109862:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832764.173932:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832764.173958:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300849920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832764.174026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832764.174111:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300849920 00000100:00100000:1.0:1787832764.174117:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300849920 00000100:00100000:1.0:1787832764.174168:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787832764.174187:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300849920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832764.174215:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832764.174250:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300849920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832764.174255:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787832764.174410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787832764.174439:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546495680 x1874678300849920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832764.174457:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300849920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832764.688914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300850176:0@lo:400:kworker.0 00000100:00100000:0.0:1787832764.688990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832764.689043:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832764.689048:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300850304:0@lo:400:kworker.0 00000100:00100000:0.0:1787832764.689068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832764.689104:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850176 00000100:00100000:0.0:1787832764.689111:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850176 00000100:00100000:0.0:1787832764.689154:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850304 00000100:00100000:0.0:1787832764.689157:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850304 00000100:00100000:0.0:1787832764.689181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787832764.689189:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300850176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832764.689247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300850176:12345-0@lo:400:kworker.0 Request processed in 58us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832764.689255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787832764.689271:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787832764.689277:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300850304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832764.689312:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300850304:12345-0@lo:400:kworker.0 Request processed in 35us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832764.689318:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787832764.689362:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300850304:0@lo:400:kworker.0 00000100:00100000:0.0:1787832764.689372:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300850176:0@lo:400:kworker.0 00000100:00100000:3.0:1787832764.689545:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300850048:0@lo:400:kworker.0 00000100:00100000:1.0:1787832764.689561:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300850432:0@lo:400:kworker.0 00000100:00100000:3.0:1787832764.689586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832764.689601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832764.689664:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832764.689672:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300850688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832764.689725:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832764.689751:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300850560:0@lo:400:kworker.0 00000100:00100000:1.0:1787832764.689764:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850688 00000100:00100000:1.0:1787832764.689769:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850688 00000100:00100000:3.0:1787832764.689782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832764.689813:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787832764.689817:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832764.689822:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300850688:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787832764.689823:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832764.689837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850048 00000100:00100000:3.0:1787832764.689842:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850048 00002000:00000024:1.0:1787832764.689854:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832764.689873:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787832764.689882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300850048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832764.689899:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300850688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832764.689907:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787832764.689925:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300850048:12345-0@lo:400:kworker.0 Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832764.689944:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:1.0:1787832764.689945:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35464961c0 x1874678300850688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832764.689963:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300850688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832764.689989:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850560 00000100:00100000:3.0:1787832764.689994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850560 00000100:00100000:1.0:1787832764.690000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850432 00000100:00100000:1.0:1787832764.690005:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850432 00000100:00100000:3.0:1787832764.690026:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787832764.690036:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300850560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832764.690044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787832764.690052:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300850432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832764.690074:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300850560:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832764.690082:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832764.690093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300850432:12345-0@lo:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832764.690105:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787832764.690130:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300850432:0@lo:400:kworker.0 00000100:00080000:3.0:1787832764.690178:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832764.690208:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300850048:0@lo:400:kworker.0 00010000:00080000:3.0:1787832764.690219:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b86e1c0 x1874678300850560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832764.690229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300850560:0@lo:400:kworker.0 00010000:00010000:0.0:1787832765.132012:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832766.157546:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832766.969862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832766.969929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990848 00000100:00100000:0.0:1787832766.969940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990848 00000100:00100000:0.0:1787832766.970007:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:0.0:1787832766.970018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678282990848:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832766.970107:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678282990848:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832766.970114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:1.0:1787832766.971579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832766.971674:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282990976 00000100:00100000:0.0:1787832766.971681:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282990976 00000100:00100000:0.0:1787832766.971780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1787832766.971790:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282990976:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832766.971857:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678282990976:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832766.971882:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00080000:3.0:1787832766.972005:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832766.992447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832766.992507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832766.992576:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991232 00000100:00100000:2.0:1787832766.992586:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991232 00000100:00100000:0.0:1787832766.992634:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991104 00000100:00100000:0.0:1787832766.992640:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991104 00000100:00100000:2.0:1787832766.992675:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832766.992685:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:0.0:1787832766.992696:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282991104:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832766.992733:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282991232:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1787832766.992816:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787832766.992821:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832766.992892:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282991232:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 208us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832766.992900:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832766.994311:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282991104:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1612us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832766.994320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:3.0:1787832766.995667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832766.995740:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991360 00000100:00100000:0.0:1787832766.995749:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991360 00000100:00100000:0.0:1787832766.995799:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1787832766.995806:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282991360:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1787832766.995847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832766.998861:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282991360:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 3043us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832766.998875:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00010000:00010000:1.0:1787832767.180776:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832768.203864:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832769.227863:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832769.292863:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300850816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832769.292940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832769.293132:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850816 00000100:00100000:1.0:1787832769.293140:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850816 00000100:00100000:1.0:1787832769.293216:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787832769.293227:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300850816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832769.293265:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832769.293318:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300850816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832769.293325:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787832769.293364:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546496940 x1874678300850816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832769.293382:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300850816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787832769.293561:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832769.804154:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832769.804177:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300850944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832769.804258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832769.804418:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300850944 00000100:00100000:1.0:1787832769.804427:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300850944 00000100:00100000:1.0:1787832769.804508:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787832769.804519:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300850944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832769.804556:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832769.804607:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300850944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832769.804632:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787832769.805028:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3560353480 x1874678300850944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832769.805047:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300850944:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787832769.805314:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832769.807092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300851072:0@lo:400:kworker.0 00000100:00100000:2.0:1787832769.807161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832769.809650:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300851328:0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.809734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832769.809773:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832769.809780:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300851200:0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.809805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832769.809839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851328 00000100:00100000:1.0:1787832769.809846:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851328 00000100:00100000:1.0:1787832769.809898:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851200 00000100:00100000:1.0:1787832769.809902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851200 00000100:00100000:1.0:1787832769.809925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787832769.809934:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300851328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.809987:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300851328:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832769.809994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787832769.810012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787832769.810037:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300851200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.810069:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300851200:12345-0@lo:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832769.810075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787832769.810100:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832769.810128:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300851200:0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.810149:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300851328:0@lo:400:kworker.0 00000100:00100000:2.0:1787832769.810773:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832769.810783:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300851456:0@lo:400:kworker.0 00000100:00100000:2.0:1787832769.810819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832769.810961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851072 00000100:00100000:3.0:1787832769.810966:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851072 00000100:00100000:3.0:1787832769.811073:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787832769.811081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300851072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832769.811122:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300851072:12345-0@lo:400:kworker.0 Request processed in 43us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832769.811128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787832769.811201:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851456 00000100:00100000:1.0:1787832769.811207:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851456 00000100:00100000:3.0:1787832769.811215:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300851072:0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.811302:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787832769.811312:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300851456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832769.811356:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300851456:12345-0@lo:400:kworker.0 Request processed in 47us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832769.811363:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787832769.811381:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300851456:0@lo:400:kworker.0 00000100:00080000:2.0:1787832769.812522:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787832770.252772:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832771.275952:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832772.092480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832772.092520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832772.092577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991488 00000100:00100000:3.0:1787832772.092586:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991488 00000100:00100000:3.0:1787832772.092638:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:3.0:1787832772.092648:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678282991488:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832772.092737:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678282991488:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832772.092746:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:2.0:1787832772.092955:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991616 00000100:00100000:2.0:1787832772.092960:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991616 00000100:00100000:2.0:1787832772.093019:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:2.0:1787832772.093026:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282991616:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832772.093056:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282991616:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832772.093062:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00080000:3.0:1787832772.093977:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832772.098638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832772.098691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832772.098738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832772.098765:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991872 00000100:00100000:3.0:1787832772.098774:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991872 00000100:00100000:3.0:1787832772.098848:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992000 00000100:00100000:3.0:1787832772.098852:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992000 00000100:00100000:3.0:1787832772.098880:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787832772.098890:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2351:x1874678282991872:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1787832772.098921:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6cda 00000100:00080000:3.0:1787832772.098930:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357c690000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787832772.098971:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787832772.099517:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+2:2351:x1874678282991872:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 626us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832772.099525:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787832772.099551:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787832772.099558:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2351:x1874678282992000:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1787832772.099571:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6ce1 00000100:00080000:3.0:1787832772.099577:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357c695800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787832772.099600:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787832772.099953:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282991744 00000100:00100000:2.0:1787832772.099959:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282991744 00000100:00100000:2.0:1787832772.099999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:2.0:1787832772.100019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282991744:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832772.100057:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282991744:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 50us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832772.100064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00010000:00010000:2.0:1787832772.100087:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832772.100249:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+2:2351:x1874678282992000:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 690us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832772.100257:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:3.0:1787832772.100428:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787832772.100437:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787832772.100441:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787832772.100443:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787832772.300078:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832773.324326:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832774.350227:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832774.412043:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300851584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832774.412124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.412499:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851584 00000100:00100000:1.0:1787832774.412508:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851584 00000100:00100000:1.0:1787832774.412585:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787832774.412596:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300851584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832774.412635:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832774.412723:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300851584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832774.412730:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787832774.412775:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546494780 x1874678300851584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832774.412792:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300851584:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787832774.412869:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787832774.588622:0:11022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787832774.923826:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832774.923849:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300851712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832774.923939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.924010:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851712 00000100:00100000:1.0:1787832774.924017:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851712 00000100:00100000:1.0:1787832774.924071:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787832774.924081:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300851712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832774.924114:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832774.924165:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300851712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832774.924182:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787832774.924298:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3546494780 x1874678300851712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832774.924318:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300851712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787832774.924502:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832774.925500:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300852224:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.925681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.925733:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832774.925740:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300851840:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.925768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.925800:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300851968:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.925823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.925842:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832774.925847:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300852096:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.925869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832774.925898:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852224 00000100:00100000:1.0:1787832774.925904:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852224 00000100:00100000:1.0:1787832774.925945:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851968 00000100:00100000:1.0:1787832774.925948:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851968 00000100:00100000:1.0:1787832774.925960:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852096 00000100:00100000:1.0:1787832774.925963:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852096 00000100:00100000:1.0:1787832774.925996:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787832774.926005:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300852224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.926051:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300852224:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832774.926058:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787832774.926071:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787832774.926078:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300851968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.926108:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300851968:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832774.926115:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787832774.926127:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787832774.926133:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300852096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.926181:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300852096:12345-0@lo:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832774.926188:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787832774.926394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300851840 00000100:00100000:3.0:1787832774.926398:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300851840 00000100:00100000:3.0:1787832774.926437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787832774.926444:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300851840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832774.926483:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300851840:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832774.926489:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:3.0:1787832774.926514:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832774.927396:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300851840:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.927414:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300852224:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.927441:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300852096:0@lo:400:kworker.0 00000100:00100000:1.0:1787832774.927450:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300851968:0@lo:400:kworker.0 00010000:00010000:0.0:1787832775.371977:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787832776.038196:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000020:00000080:1.0:1787832776.038209:0:7648:0:(genops.c:885:class_export_put()) final put ffff8c357c696000/2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000020:00000080:1.0:1787832776.038247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c696000/2f665ede-f2c4-41f1-a7ce-59cc3155785a for lustre-OST0001 00000020:00000080:1.0:1787832776.038310:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357c695800 for lustre-OST0001 00000001:00100000:2.0:1787832776.039185:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000020:00000080:2.0:1787832776.039209:0:6720:0:(genops.c:885:class_export_put()) final put ffff8c357c693800/2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000020:00000080:1.0:1787832776.039906:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c693800/2f665ede-f2c4-41f1-a7ce-59cc3155785a for lustre-OST0000 00000020:00000080:1.0:1787832776.039973:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357c690000 for lustre-OST0000 00010000:00010000:3.0:1787832776.400005:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832777.210363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832777.210402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832777.210433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832777.210466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992384 00000100:00100000:2.0:1787832777.210477:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992384 00000100:00100000:2.0:1787832777.210539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992256 00000100:00100000:2.0:1787832777.210542:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992256 00000100:00100000:2.0:1787832777.210565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787832777.210574:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282992384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832777.210655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678282992384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832777.210664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787832777.210682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:2.0:1787832777.210688:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35591930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282992256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832777.210732:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35591930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678282992256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832777.210739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00080000:2.0:1787832777.210760:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832777.215522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992128 00000100:00100000:1.0:1787832777.215539:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992128 00000100:00100000:1.0:1787832777.215619:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:1.0:1787832777.215630:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282992128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832777.215746:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282992128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 117us (5398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832777.215754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00010000:00010000:3.0:1787832777.421843:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832778.448086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787832778.493082:0:11172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc46c61080 20000000:00000080:1.0:1787832778.493107:0:11172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c355cffc000 uarg=0000000000000000 20000000:01000000:1.0:1787832778.493375:0:11172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787832778.493384:0:11172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787832778.493390:0:11172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787832778.495031:0:11173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787832778.495417:0:11172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787832778.505023:0:11172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787832778.505552:0:11172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505582:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505594:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505601:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505609:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505638:0:11172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505647:0:11172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505881:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.505902:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 12 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.505923:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb44b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852352:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832778.506072:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.506080:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 18 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.506089:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852480:0@lo:104: 00000100:00100000:1.0:1787832778.506153:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832778.506208:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.506217:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.506226:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852608:0@lo:104: 00000100:00100000:1.0:1787832778.506353:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832778.506379:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.506388:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 18 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.506396:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb45e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852736:0@lo:104: 00000100:00100000:1.0:1787832778.506417:0:11172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787832778.506434:0:11172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.506443:0:11172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.506452:0:11172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852864:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832778.506479:0:11172:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832778.508411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852480 00000100:00100000:0.0:1787832778.508429:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852480 00000100:00100000:0.0:1787832778.508504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852608 00000100:00100000:0.0:1787832778.508509:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852608 00000100:00100000:0.0:1787832778.508521:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852736 00000100:00100000:0.0:1787832778.508524:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852736 00000100:00100000:0.0:1787832778.508545:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787832778.508574:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:11172:x1874678300852480:12345-0@lo:104: 00010000:00010000:0.0:1787832778.508596:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.508764:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832778.508771:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+5:11172:x1874678300852480:12345-0@lo:104: Request processed in 200us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.508779:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787832778.508798:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787832778.508804:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:11172:x1874678300852608:12345-0@lo:104: 00010000:00010000:0.0:1787832778.508813:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.508853:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787832778.508858:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+4:11172:x1874678300852608:12345-0@lo:104: Request processed in 55us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.508864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787832778.508876:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787832778.508883:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:11172:x1874678300852736:12345-0@lo:104: 00010000:00010000:0.0:1787832778.508891:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.508928:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787832778.508932:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+3:11172:x1874678300852736:12345-0@lo:104: Request processed in 51us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.508938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787832778.508963:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787832778.508977:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.508985:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832778.508990:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509000:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832778.509007:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832778.509013:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787832778.509058:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509065:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832778.509090:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509097:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b6cb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509126:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832778.509129:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509135:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832778.509138:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.509154:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832778.509160:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509525:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832778.509534:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509541:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74da00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832778.509544:0:7636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509565:0:7636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832778.509571:0:7636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832778.509576:0:7636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787832778.509598:0:7636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509605:0:7636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787832778.509626:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509633:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74da00/0x72bd9178b14b6c94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6c9b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832778.509644:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832778.509645:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832778.509647:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832778.510030:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852480:0@lo:104: 00000100:00100000:1.0:1787832778.510044:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb470c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852608:0@lo:104: 00000100:00100000:1.0:1787832778.510052:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb45e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852736:0@lo:104: 10000000:01000000:0.0:1787832778.510128:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787832778.510158:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510501:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832778.510513:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540030800/0x72bd9178b14b6ca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6ca9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832778.510541:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832778.510543:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832778.510551:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832778.510570:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300852992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787832778.510651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832778.510752:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300852992 00000100:00100000:0.0:1787832778.510759:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300852992 00010000:00010000:0.0:1787832778.510791:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832778.510824:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787832778.510846:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300852992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787832778.510862:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832778.510868:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510880:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510897:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74c400/0x72bd9178b14b6cb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6cb0 expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.510913:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832778.510949:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3308:x1874678300852992:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.510957:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787832778.511025:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300852992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832778.512437:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb44b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852352:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832778.512468:0:11172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11172:1874678300852864:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832778.512515:0:11172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832778.512737:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300853248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832778.512798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832778.512854:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832778.512862:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300853120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832778.512884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832778.512975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853248 00000100:00100000:1.0:1787832778.512982:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853248 00010000:00010000:1.0:1787832778.513022:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 18 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.513057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853120 00000100:00100000:1.0:1787832778.513060:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853120 00010000:00010000:1.0:1787832778.513075:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832778.513120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832778.513130:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300853248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832778.513146:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832778.513151:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513366:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513393:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6ca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6ca2 expref: 19 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513414:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832778.513461:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3306:x1874678300853248:12345-0@lo:103:ldlm_bl.0 Request processed in 333us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832778.513468:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832778.513488:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832778.513495:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:3306:x1874678300853120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832778.513503:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832778.513508:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 17 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513516:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 17 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513526:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540030400/0x72bd9178b14b6c9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6c94 expref: 17 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832778.513548:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832778.513572:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3306:x1874678300853120:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832778.513579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832778.513620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300853120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832778.513629:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300853248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832778.514469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832778.514511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832778.514584:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992512 00000100:00100000:0.0:1787832778.514592:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992512 00010000:00010000:0.0:1787832778.514628:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 13 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832778.514658:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992640 00000100:00100000:0.0:1787832778.514661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992640 00010000:00010000:0.0:1787832778.514674:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 14 pid: 5840 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832778.514696:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832778.514732:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+14:2352:x1874678282992512:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832778.514745:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832778.514764:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 14 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514776:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 14 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514793:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b6ccc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066b0 expref: 14 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514808:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832778.514862:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678282992512:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 158us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.514870:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832778.514885:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787832778.514891:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:2352:x1874678282992640:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832778.514899:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832778.514903:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514913:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514923:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86800/0x72bd9178b14b6c8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706678 expref: 12 pid: 5840 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514935:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514944:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514968:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514975:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514982:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514989:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.514996:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832778.515001:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.515010:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.515023:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832778.515033:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832778.515054:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:2352:x1874678282992640:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 163us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832778.515061:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00010000:00010000:3.0:1787832778.516032:0:11172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832778.516048:0:11172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832778.516054:0:11172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad41400/0x72bd9178b14b6ce8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832779.468058:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832779.532108:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832779.532145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300853376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832779.532250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832779.532439:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853376 00000100:00100000:1.0:1787832779.532451:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853376 00000100:00100000:1.0:1787832779.532542:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787832779.532554:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300853376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832779.532605:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832779.532669:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300853376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832779.532677:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787832779.532752:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb46d00 x1874678300853376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832779.532775:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300853376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787832779.532865:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832780.045413:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b8983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300853504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832780.045527:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832780.045620:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853504 00000100:00100000:3.0:1787832780.045630:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853504 00000100:00100000:3.0:1787832780.045698:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787832780.045727:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300853504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832780.045772:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832780.045825:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300853504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832780.045846:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787832780.045871:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787832780.045921:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b8983c0 x1874678300853504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832780.045943:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b8983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300853504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832780.046519:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300853632:0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.046570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832780.046618:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300854144:0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.046674:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300853760:0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.046728:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.046734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832780.046760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832780.046774:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853760 00000100:00100000:1.0:1787832780.046780:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853760 00000100:00100000:3.0:1787832780.046781:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832780.046787:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300854016:0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.046814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832780.046820:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853888 00000100:00100000:1.0:1787832780.046830:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853888 00000100:00100000:3.0:1787832780.046845:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787832780.046854:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300853760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.046861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787832780.046866:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300853888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.046900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300853760:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832780.046900:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300853888:12345-0@lo:400:kworker.0 Request processed in 33us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832780.047023:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787832780.047047:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854016 00000100:00100000:3.0:1787832780.047051:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854016 00000100:00100000:1.0:1787832780.047074:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787832780.047081:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787832780.047087:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300854016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.047120:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300854016:12345-0@lo:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832780.047132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787832780.047150:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832780.047174:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300853760:0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.047204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.047740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300853632 00000100:00100000:2.0:1787832780.047748:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300853632 00000100:00100000:2.0:1787832780.047787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787832780.047796:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3305:x1874678300853632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832780.047853:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3305:x1874678300853632:12345-0@lo:400:kworker.0 Request processed in 58us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832780.047870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787832780.049569:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300853632:0@lo:400:kworker.0 00010000:00080000:3.0:1787832780.049627:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3565c73480 x1874678300854016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832780.049641:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300854016:0@lo:400:kworker.0 00000100:00100000:3.0:1787832780.049654:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.050810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854144 00000100:00100000:1.0:1787832780.050823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854144 00000100:00080000:3.0:1787832780.051099:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832780.051191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787832780.051205:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300854144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.051331:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300854144:12345-0@lo:400:kworker.0 Request processed in 128us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832780.051508:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300854144:0@lo:400:kworker.0 00000100:00100000:1.0:1787832780.051693:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 10000000:01000000:2.0:1787832780.368753:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832780.368765:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a1800 from 7 10000000:01000000:2.0:1787832780.368772:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832780.368851:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.368867:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.368881:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832780.368914:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.369011:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.369073:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832780.370225:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854272 00000100:00100000:0.0:1787832780.370240:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854272 00000100:00100000:0.0:1787832780.370344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787832780.370355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300854272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.370394:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832780.370417:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6cef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.370449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.370463:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.370473:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:0.0:1787832780.370560:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.370568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787832780.370635:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c71e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.370654:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.370665:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832780.370780:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.370816:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832780.370844:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66000 going to sleep for 11 seconds 00000100:00100000:2.0:1787832780.371442:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854400 00000100:00100000:2.0:1787832780.371450:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854400 00000100:00100000:2.0:1787832780.371500:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787832780.371511:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.372298:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 785us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832780.372308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787832780.372482:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.372540:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.372602:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832780.372641:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66000 going to sleep for 11 seconds 00000100:00100000:2.0:1787832780.376774:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854528 00000100:00100000:2.0:1787832780.376797:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854528 00000100:00100000:2.0:1787832780.376908:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787832780.376921:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.377669:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 746us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832780.377689:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787832780.377872:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787832780.379931:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787832780.380281:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787832780.380305:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832780.380318:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.380332:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832780.380345:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832780.380348:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357c687800 from 7 10000000:01000000:2.0:1787832780.380351:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832780.380404:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.380413:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.380426:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832780.380456:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.380544:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.380602:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832780.381172:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854656 00000100:00100000:0.0:1787832780.381183:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854656 00000100:00100000:0.0:1787832780.381249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787832780.381278:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300854656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.381297:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832780.381317:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6cfd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.381346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.381358:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.381366:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832780.381427:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300854656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.381434:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787832780.381618:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832780.381636:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.381645:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832780.381768:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.381803:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.381917:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832780.381988:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854784 00000100:00100000:0.0:1787832780.381992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854784 00000100:00100000:0.0:1787832780.382026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787832780.382033:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300854784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.383150:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300854784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1110us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.383169:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787832780.389033:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.389135:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.389413:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.389548:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787832780.393591:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300854912 00000100:00100000:1.0:1787832780.393616:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300854912 00000100:00100000:1.0:1787832780.393722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787832780.393735:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300854912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832780.394080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300854912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 346us (4822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832780.394089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787832780.394264:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300854912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787832780.398976:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787832780.399061:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787832780.399085:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832780.399103:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.399117:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832780.399130:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832780.399134:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3543878800 from 7 10000000:01000000:2.0:1787832780.399137:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832780.399187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.399197:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.399228:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832780.399274:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.399366:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832780.399414:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787832780.399722:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855040 00000100:00100000:0.0:1787832780.399731:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855040 00000100:00100000:0.0:1787832780.399792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787832780.399803:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300855040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.399820:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832780.399838:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6d0b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.399868:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.399880:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.399889:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832780.399944:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300855040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.399951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787832780.400008:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c70f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.400024:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.400035:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832780.400099:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.400143:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832780.400159:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832780.400240:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855168 00000100:00100000:2.0:1787832780.400244:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855168 00000100:00100000:2.0:1787832780.400284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787832780.400292:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300855168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.400589:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300855168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832780.400596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787832780.400899:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.400939:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.400984:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832780.401004:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832780.401019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855296 00000100:00100000:0.0:1787832780.401023:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855296 00000100:00100000:0.0:1787832780.401047:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787832780.401053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300855296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.401222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300855296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.401229:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787832780.401276:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300855296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787832780.415807:0:11230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787832780.415925:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787832780.415964:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832780.415980:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832780.415996:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832780.479358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832780.481019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992768 00000100:00100000:3.0:1787832780.481036:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992768 00000100:00100000:3.0:1787832780.481115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 243 00000100:00100000:3.0:1787832780.481138:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:5598:x1874678282992768:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832780.481162:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832780.481185:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066da expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832780.481574:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832780.481590:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832780.481617:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86a00, rc 0) 00000100:00100000:3.0:1787832780.481726:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282992768:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 590us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832780.481735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 243 00010000:00010000:0.0:1787832780.492790:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832780.497863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832780.497937:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282992896 00000100:00100000:2.0:1787832780.498018:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282992896 00000100:00100000:2.0:1787832780.498102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:2.0:1787832780.498115:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282992896:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832780.500188:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282992896:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 2056us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832780.500207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 244 00000100:00100000:3.0:1787832780.507949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832780.508083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993024 00000100:00100000:0.0:1787832780.508099:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993024 00000100:00100000:0.0:1787832780.508173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:0.0:1787832780.508188:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282993024:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.508542:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282993024:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 357us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.508552:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 245 00000100:00100000:3.0:1787832780.518850:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832780.518953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993152 00000100:00100000:0.0:1787832780.518966:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993152 00000100:00100000:0.0:1787832780.519059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:0.0:1787832780.519072:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282993152:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832780.519093:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832780.519117:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066e1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.519153:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.519167:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832780.519178:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832780.519242:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678282993152:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.519249:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 246 00000100:00100000:3.0:1787832780.520978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832780.521061:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993280 00000100:00100000:0.0:1787832780.521071:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993280 00000100:00100000:0.0:1787832780.521126:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 247 00000100:00100000:0.0:1787832780.521136:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678282993280:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832780.521519:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678282993280:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 385us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832780.521529:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 247 00000100:00100000:3.0:1787832780.530985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832780.531053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993408 00000100:00100000:1.0:1787832780.531068:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993408 00000100:00100000:1.0:1787832780.531145:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 248 00000100:00100000:1.0:1787832780.531160:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678282993408:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832780.531481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678282993408:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 324us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832780.531622:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 248 00010000:00010000:0.0:1787832781.516961:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832782.330046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832782.330194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832782.330364:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993664 00000100:00100000:2.0:1787832782.330378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993664 00000100:00100000:2.0:1787832782.330599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:2.0:1787832782.330611:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282993664:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832782.330732:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678282993664:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 123us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832782.330741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:0.0:1787832782.333873:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993536 00000100:00100000:0.0:1787832782.333894:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993536 00000100:00080000:3.0:1787832782.342015:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832782.342149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832782.343129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993792 00000100:00100000:2.0:1787832782.343144:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993792 00000100:00100000:2.0:1787832782.343244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:2.0:1787832782.343257:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282993792:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832782.343357:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678282993792:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 103us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832782.343365:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00080000:3.0:1787832782.343499:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832782.343595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 249 00000100:00100000:1.0:1787832782.343604:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678282993536:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832782.343648:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678282993536:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 45us (13619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832782.343655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 249 00010000:00010000:3.0:1787832782.548040:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787832783.173193:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787832783.564055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832784.588334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832784.652524:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832784.652555:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300855424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832784.652656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832784.652775:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855424 00000100:00100000:1.0:1787832784.652784:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855424 00000100:00100000:1.0:1787832784.652856:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787832784.652867:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300855424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832784.652913:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832784.652965:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300855424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832784.652974:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787832784.652998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787832784.653033:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb443c0 x1874678300855424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832784.653055:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300855424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832785.165925:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832785.165959:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300855552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832785.166063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832785.166160:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855552 00000100:00100000:3.0:1787832785.166178:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855552 00000100:00100000:3.0:1787832785.166249:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787832785.166259:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300855552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832785.166303:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832785.166359:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300855552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832785.166386:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787832785.166410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787832785.166450:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b899a40 x1874678300855552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832785.166472:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300855552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832785.167006:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300856064:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832785.167085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787832785.167092:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300855680:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832785.167151:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300856192:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832785.167217:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300855936:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832785.167263:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787832785.167268:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300855808:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832785.167319:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856064 00000100:00100000:0.0:1787832785.167324:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856064 00000100:00100000:0.0:1787832785.167361:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787832785.167369:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300856064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167411:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300856064:12345-0@lo:400:kworker.0 Request processed in 43us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832785.167417:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787832785.167437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856192 00000100:00100000:0.0:1787832785.167440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856192 00000100:00100000:0.0:1787832785.167470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855936 00000100:00100000:0.0:1787832785.167472:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855936 00000100:00100000:0.0:1787832785.167486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855808 00000100:00100000:0.0:1787832785.167488:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855808 00000100:00100000:0.0:1787832785.167502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787832785.167507:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300856192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167539:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300856192:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832785.167554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787832785.167566:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787832785.167571:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300855936:12345-0@lo:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832785.167611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787832785.167622:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787832785.167628:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300855808:12345-0@lo:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832785.167657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787832785.167727:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300855808:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300855936:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167766:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300856192:0@lo:400:kworker.0 00010000:00080000:0.0:1787832785.167777:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b86f0c0 x1874678300856064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832785.167786:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300856064:0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300855680 00000100:00100000:0.0:1787832785.167838:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300855680 00000100:00100000:0.0:1787832785.167865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787832785.167871:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832785.167907:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300855680:12345-0@lo:400:kworker.0 Request processed in 35us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832785.167923:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787832785.167961:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300855680:0@lo:400:kworker.0 00000100:00080000:3.0:1787832785.169153:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787832785.611985:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832786.637896:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787832786.944629:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:13:05 (1787832785) === 00000100:00100000:3.0:1787832787.188847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.188897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832787.189008:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282993920 00000100:00100000:0.0:1787832787.189021:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282993920 00000100:00100000:0.0:1787832787.189098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832787.189112:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282993920:12345-192.168.201.34@tcp:41:mkdir.0 00000004:00000024:0.0:1787832787.189191:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787832787.189483:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678282993920:12345-192.168.201.34@tcp:41:mkdir.0 Request processed in 361us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832787.189499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787832787.190344:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994048 00000100:00100000:2.0:1787832787.190353:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994048 00000100:00100000:2.0:1787832787.190411:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787832787.190420:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9678:x1874678282994048:12345-192.168.201.34@tcp:700:mkdir.0 00000100:00100000:2.0:1787832787.190516:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9678:x1874678282994048:12345-192.168.201.34@tcp:700:mkdir.0 Request processed in 98us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.190525:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00080000:3.0:1787832787.190745:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832787.200383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832787.200437:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994304 00000100:00100000:0.0:1787832787.200448:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994304 00000100:00100000:0.0:1787832787.200500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787832787.200511:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9678:x1874678282994304:12345-192.168.201.34@tcp:36:mkdir.0 00010000:00010000:0.0:1787832787.201984:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832787.202084:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6c08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706663 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202109:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f100) 00010000:00010000:0.0:1787832787.202123:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832787.202466:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202482:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202505:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202518:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202525:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.202532:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832787.204832:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787832787.204849:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204859:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204865:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204871:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832787.204874:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204881:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204895:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f000) 00010000:00010000:0.0:1787832787.204898:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832787.204909:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.204915:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832787.205394:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056037d54 reply state 00000000d7f29ee0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.205405:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832787.205513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9678:x1874678282994304:12345-192.168.201.34@tcp:36:mkdir.0 Request processed in 4999us (5136us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787832787.205523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:3.0:1787832787.212185:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212209:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212219:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212226:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.212232:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212242:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212271:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c3542b1f600) 00010000:00010000:3.0:1787832787.212276:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.212295:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.212303:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d2e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832787.228784:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.229090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994432 00000100:00100000:2.0:1787832787.229105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994432 00000100:00100000:2.0:1787832787.229212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1787832787.229229:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9679:x1874678282994432:12345-192.168.201.34@tcp:101:chmod.0 00010000:00010000:2.0:1787832787.229263:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832787.229297:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6d35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066e8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.229393:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.229412:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.229429:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832787.237570:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787832787.237584:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832787.237680:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.237759:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e8 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.237786:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e8 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.237797:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:2.0:1787832787.237800:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832787.237820:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74da00, rc 0) 00000100:00100000:2.0:1787832787.239004:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9679:x1874678282994432:12345-192.168.201.34@tcp:101:chmod.0 Request processed in 9769us (10221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.239019:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:2.0:1787832787.248903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832787.248979:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994688 00000100:00100000:0.0:1787832787.248993:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994688 00000100:00100000:0.0:1787832787.249076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832787.249087:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9679:x1874678282994688:12345-192.168.201.34@tcp:36:chmod.0 00010000:00010000:0.0:1787832787.249157:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832787.249187:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6d3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e8 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.249210:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:0.0:1787832787.249221:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832787.249247:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.249260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.249270:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832787.249608:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008db2df6b reply state 00000000c5656dbb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.249618:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787832787.249631:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787832787.249778:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:9679:x1874678282994688:12345-192.168.201.34@tcp:36:chmod.0 Request processed in 690us (887us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787832787.249787:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00010000:00010000:3.0:1787832787.264657:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264682:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264691:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264721:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.264728:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264738:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264761:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f000) 00010000:00010000:3.0:1787832787.264764:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787832787.264836:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.264845:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6d43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832787.292468:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.292730:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994816 00000100:00100000:3.0:1787832787.292742:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994816 00000100:00100000:3.0:1787832787.292841:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1787832787.292852:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9680:x1874678282994816:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:3.0:1787832787.292886:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832787.292916:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6d4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066ef expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293006:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293025:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293039:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832787.293140:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787832787.293144:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832787.293204:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293237:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066ef expref: 9 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293260:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066ef expref: 8 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.293271:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832787.293274:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832787.293278:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86400, rc 0) 00000100:00100000:3.0:1787832787.293367:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:9680:x1874678282994816:12345-192.168.201.34@tcp:101:chown.0 Request processed in 517us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832787.293386:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787832787.296147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832787.297316:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282994944 00000100:00100000:0.0:1787832787.297394:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282994944 00000100:00100000:0.0:1787832787.297745:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832787.297758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:9680:x1874678282994944:12345-192.168.201.34@tcp:101:chown.0 00010000:00010000:0.0:1787832787.297786:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832787.297812:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066f6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297901:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297919:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297932:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297957:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.297982:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.298110:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.298119:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300435:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832787.300535:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787832787.300540:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832787.300582:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300600:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300607:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300621:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832787.300625:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300634:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300671:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:0.0:1787832787.300675:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832787.300680:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300688:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300726:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300733:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300739:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300745:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832787.300748:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300755:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300764:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c3542b1f100) 00010000:00010000:0.0:1787832787.300766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832787.300769:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300775:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6d66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300844:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b6d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066f6 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300861:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066f6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.300869:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3542b1f800) 00010000:00010000:0.0:1787832787.300871:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832787.300874:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00100000:0.0:1787832787.300981:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:9680:x1874678282994944:12345-192.168.201.34@tcp:101:chown.0 Request processed in 3225us (4866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832787.300992:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832787.310994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.311098:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282995200 00000100:00100000:3.0:1787832787.311111:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282995200 00000100:00100000:3.0:1787832787.311210:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787832787.311222:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:9680:x1874678282995200:12345-192.168.201.34@tcp:36:chown.0 00010000:00010000:3.0:1787832787.311298:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832787.311345:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066f6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.311371:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3542b1f800) 00010000:00010000:3.0:1787832787.311383:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832787.311415:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.311430:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.311441:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832787.369308:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1787832787.369341:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787832787.369683:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8cf64ef reply state 0000000065490974 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832787.369737:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787832787.369964:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787832787.370117:0:10395:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787832787.370154:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9680:x1874678282995200:12345-192.168.201.34@tcp:36:chown.0 Request processed in 58926us (59168us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787832787.370166:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:3.0:1787832787.371685:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371739:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371748:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371755:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.371777:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371787:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371808:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543a9cc00) 00010000:00010000:3.0:1787832787.371811:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787832787.371816:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.371823:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6d74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.409348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.409579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282995328 00000100:00100000:2.0:1787832787.409594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282995328 00000100:00100000:2.0:1787832787.409677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787832787.409691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9681:x1874678282995328:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:2.0:1787832787.409766:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832787.409796:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6d7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7066fd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787832787.415831:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5964us 00010000:00010000:1.0:1787832787.427902:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.427935:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.427950:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.427969:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.427977:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.427984:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428739:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428752:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428760:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832787.428848:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787832787.428859:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832787.428956:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428973:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428980:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428988:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.428995:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832787.428999:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429007:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429022:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:1.0:1787832787.429025:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832787.429031:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429051:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429057:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429072:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429078:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832787.429081:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429086:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429093:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c3543c5af00) 00010000:00010000:1.0:1787832787.429095:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832787.429098:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429104:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429159:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6d7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066fd expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429177:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066fd expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.429184:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:1.0:1787832787.429187:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787832787.429189:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832787.432338:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9681:x1874678282995328:12345-192.168.201.34@tcp:101:touch.500 Request processed in 22633us (23000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832787.432377:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787832787.438654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832787.439413:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282995584 00000100:00100000:1.0:1787832787.439425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282995584 00000100:00100000:1.0:1787832787.439497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787832787.439510:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9681:x1874678282995584:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:1.0:1787832787.439543:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832787.439573:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b6d97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706704 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.442587:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.442614:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.442626:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.443000:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.443010:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.443017:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787832787.450343:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00000100:00100000:3.0:1787832787.450789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.450858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832787.450873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282995840 00000100:00100000:1.0:1787832787.450886:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282995840 00000100:00100000:1.0:1787832787.450973:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:1.0:1787832787.450993:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678282995840:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1787832787.451082:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832787.451091:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678282995840:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832787.451104:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00010000:00010000:0.0:1787832787.451914:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.451933:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.451944:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.451982:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.451996:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452002:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452008:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832787.452012:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452019:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452030:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:0.0:1787832787.452033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832787.452038:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452044:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b6d9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832787.452056:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085de8f28 reply state 000000000156767d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.452063:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787832787.452098:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b6d97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706704 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832787.452112:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706704 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832787.452249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282995712 00000100:00100000:2.0:1787832787.452263:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282995712 00010000:00010000:0.0:1787832787.452335:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3542b1f100) 00010000:00010000:0.0:1787832787.452340:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832787.452345:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:2.0:1787832787.452351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 251 00000100:00100000:2.0:1787832787.452364:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678282995712:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832787.452453:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678282995712:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 92us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.452462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 251 00000100:00100000:0.0:1787832787.452586:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:9681:x1874678282995584:12345-192.168.201.34@tcp:101:touch.500 Request processed in 13076us (13954us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787832787.452596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:3.0:1787832787.468143:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.468170:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.468179:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.468186:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.468193:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.468218:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.468331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:3.0:1787832787.468364:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8c3543c5af00) 00010000:00010000:3.0:1787832787.468369:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.468375:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832787.468752:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996096 00000100:00100000:1.0:1787832787.468790:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996096 00000100:00100000:1.0:1787832787.468892:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00010000:00010000:3.0:1787832787.468895:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b6da5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832787.468904:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:9681:x1874678282996096:12345-192.168.201.34@tcp:36:touch.500 00010000:00010000:1.0:1787832787.469032:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832787.469087:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706704 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.469101:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3542b1f100) 00010000:00010000:1.0:1787832787.469124:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832787.469216:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.469234:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.469245:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787832787.469465:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007afb4a32 reply state 00000000c60591d3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832787.469500:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787832787.469668:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:9681:x1874678282996096:12345-192.168.201.34@tcp:36:touch.500 Request processed in 765us (1354us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787832787.469801:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00010000:00010000:3.0:1787832787.474431:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474496:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474509:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474518:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.474526:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474536:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474558:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:3.0:1787832787.474561:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.474568:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.474575:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b6dba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.482970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832787.483062:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996224 00000100:00100000:1.0:1787832787.483080:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996224 00000100:00100000:1.0:1787832787.483228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1787832787.483244:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:9681:x1874678282996224:12345-192.168.201.34@tcp:101:touch.500 00010000:00010000:1.0:1787832787.483285:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832787.483322:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b6dc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70670b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.483418:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b6dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70670b expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.483438:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b6dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70670b expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832787.483475:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3543c5a800) 00010000:00010000:1.0:1787832787.483479:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832787.483495:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832787.483584:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:9681:x1874678282996224:12345-192.168.201.34@tcp:101:touch.500 Request processed in 345us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832787.483593:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:1.0:1787832787.487077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.487321:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996352 00000100:00100000:3.0:1787832787.487337:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996352 00000100:00100000:3.0:1787832787.487405:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787832787.487415:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874678282996352:12345-192.168.201.34@tcp:8:touch.500 00010000:00080000:3.0:1787832787.487466:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1787832787.487963:0:6696:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b6dc8 00002000:00100000:2.0:1787832787.487980:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436/ffff8c3549730800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787832787.488032:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787832787.488676:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787832787.488760:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c357c695000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832787.488865:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678282996352:12345-192.168.201.34@tcp:8:touch.500 Request processed in 1448us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.488875:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787832787.493983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832787.494487:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996480 00000100:00100000:0.0:1787832787.494507:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996480 00000100:00080000:3.0:1787832787.494839:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832787.494952:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832787.494968:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:0:x1874678282996480:12345-192.168.201.34@tcp:2:touch.500 00000100:00100000:2.0:1787832787.596047:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:0:x1874678282996480:12345-192.168.201.34@tcp:2:touch.500 Request processed in 101067us (102067us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787832787.596066:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000001:00080000:3.0:1787832787.596328:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787832787.596348:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000100:00100000:0.0:1787832787.600697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.600939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996736 00000100:00100000:3.0:1787832787.600953:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996736 00000100:00100000:3.0:1787832787.601034:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787832787.601046:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:9681:x1874678282996736:12345-192.168.201.34@tcp:35:touch.500 00000100:00100000:3.0:1787832787.601665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:9681:x1874678282996736:12345-192.168.201.34@tcp:35:touch.500 Request processed in 619us (980us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787832787.601676:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1787832787.624237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.624375:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282996864 00000100:00100000:2.0:1787832787.624388:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282996864 00000100:00100000:2.0:1787832787.624466:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:2.0:1787832787.624479:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:9682:x1874678282996864:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1787832787.624513:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832787.624539:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6dcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706712 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.624645:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.624663:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.624678:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832787.624946:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787832787.624951:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832787.625032:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.625067:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6dcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706712 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.625091:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706712 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.625101:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832787.625104:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832787.625108:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c400, rc 0) 00000100:00100000:2.0:1787832787.625197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:9682:x1874678282996864:12345-192.168.201.34@tcp:101:rm.0 Request processed in 721us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.625206:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787832787.633238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.633370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282997120 00000100:00100000:2.0:1787832787.633384:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282997120 00000100:00100000:2.0:1787832787.633466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787832787.633478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:9682:x1874678282997120:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1787832787.633505:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832787.633534:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706719 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832787.633758:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787832787.633990:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6ddd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706719 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.634009:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:2.0:1787832787.634021:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832787.634028:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706719 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.634046:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c800, rc 0) 00000100:00100000:2.0:1787832787.634143:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:9682:x1874678282997120:12345-192.168.201.34@tcp:101:rm.0 Request processed in 667us (921us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787832787.634152:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00010000:00010000:3.0:1787832787.662052:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832787.663367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832787.663487:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282997248 00000100:00100000:1.0:1787832787.663514:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282997248 00000100:00100000:1.0:1787832787.663601:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1787832787.663613:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:9682:x1874678282997248:12345-192.168.201.34@tcp:37:rm.0 00000100:00100000:1.0:1787832787.669797:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:9682:x1874678282997248:12345-192.168.201.34@tcp:37:rm.0 Request processed in 6168us (6425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832787.669817:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787832787.674771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.675059:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282997504 00000100:00100000:3.0:1787832787.675073:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282997504 00000100:00100000:3.0:1787832787.675158:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787832787.675171:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:9682:x1874678282997504:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:3.0:1787832787.675581:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af69c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:9682:x1874678282997504:12345-192.168.201.34@tcp:35:rm.0 Request processed in 411us (823us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787832787.675600:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787832787.688634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.688921:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282997760 00000100:00100000:3.0:1787832787.688955:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282997760 00000100:00100000:3.0:1787832787.689035:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1787832787.689047:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:9682:x1874678282997760:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:3.0:1787832787.689080:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832787.689109:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6deb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706720 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.689302:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6df2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.689321:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.689555:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832787.689571:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787832787.689852:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706720 expref: 17 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.689878:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706720 expref: 16 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.689888:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:3.0:1787832787.689892:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787832787.689896:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87400, rc 0) 00000100:00100000:3.0:1787832787.689979:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282997760:12345-192.168.201.34@tcp:101:rm.0 Request processed in 934us (1360us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787832787.689988:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1787832787.698590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.698777:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282997888 00000100:00100000:2.0:1787832787.698791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282997888 00000100:00100000:2.0:1787832787.698872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:2.0:1787832787.698886:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282997888:12345-192.168.201.34@tcp:41:rm.0 00000004:00000024:2.0:1787832787.698976:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787832787.699096:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282997888:12345-192.168.201.34@tcp:41:rm.0 Request processed in 212us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.699105:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832787.703309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.703426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282998016 00000100:00100000:2.0:1787832787.703439:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282998016 00000100:00100000:2.0:1787832787.703515:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787832787.703527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282998016:12345-192.168.201.34@tcp:101:rm.0 00010000:00010000:2.0:1787832787.703554:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832787.703583:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706727 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703779:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703798:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703830:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703850:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703858:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.703865:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704145:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704153:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832787.704191:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787832787.704196:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832787.704301:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704317:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704328:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704347:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704355:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704363:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832787.704368:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704377:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704393:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832787.704397:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832787.704403:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704409:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704426:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704433:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704440:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704445:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832787.704455:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704462:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704470:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8c3547ea9800) 00010000:00010000:2.0:1787832787.704473:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832787.704476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704483:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704523:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706727 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704540:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706727 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.704548:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3543c5a800) 00010000:00010000:2.0:1787832787.704551:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832787.704554:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74ce00, rc 0) 00000100:00100000:2.0:1787832787.705960:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:9682:x1874678282998016:12345-192.168.201.34@tcp:101:rm.0 Request processed in 2421us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832787.705977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:0.0:1787832787.714295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832787.714453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282998272 00000100:00100000:2.0:1787832787.714466:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282998272 00000100:00100000:2.0:1787832787.714539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832787.714552:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:9682:x1874678282998272:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1787832787.714660:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787832787.714695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706727 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714757:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b6dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70670b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714769:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3543c5a800) 00010000:00010000:2.0:1787832787.714787:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706712 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714795:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832787.714798:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832787.714825:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714841:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714853:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714870:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714878:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.714885:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.715068:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.715079:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.715087:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787832787.717653:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787832787.717677:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310745973573ns, next at 311745969616ns, rc = 0 00010000:00010000:2.0:1787832787.717863:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.717882:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.717894:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.717904:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.717911:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.717917:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718078:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832787.718107:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718140:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718146:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718152:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832787.718157:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718165:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718179:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3547ea9900) 00010000:00010000:2.0:1787832787.718183:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787832787.718187:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718194:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6e2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718226:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718233:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718239:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718244:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832787.718254:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718261:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718271:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832787.718273:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832787.718276:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832787.718282:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6e1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832787.718294:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4760b23 reply state 00000000a472690b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832787.718303:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832787.718433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282998272:12345-192.168.201.34@tcp:36:rm.0 Request processed in 3877us (4148us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787832787.718445:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00010000:00010000:3.0:1787832787.719314:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832787.719373:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.719384:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832787.719388:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.719397:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.719411:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3547ea9900) 00010000:00010000:3.0:1787832787.719414:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787832787.719418:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.719424:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.719444:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832787.719445:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832787.719447:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832787.720471:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720486:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720492:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720499:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.720503:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720523:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720537:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff8c3547ea9800) 00010000:00010000:3.0:1787832787.720539:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.720543:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.720550:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832787.726543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.726660:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282998528 00000100:00100000:3.0:1787832787.726674:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282998528 00000100:00100000:3.0:1787832787.726801:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787832787.726813:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:9682:x1874678282998528:12345-192.168.201.34@tcp:35:rm.0 00000100:00100000:3.0:1787832787.727440:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282998528:12345-192.168.201.34@tcp:35:rm.0 Request processed in 626us (911us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787832787.727450:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1787832787.731817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832787.731938:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282998784 00000100:00100000:3.0:1787832787.731953:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282998784 00000100:00100000:3.0:1787832787.732142:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1787832787.732154:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:9682:x1874678282998784:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:3.0:1787832787.732250:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787832787.732288:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87400/0x72bd9178b14b6df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706720 expref: 16 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732313:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b6d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066fd expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732357:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:3.0:1787832787.732379:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86400/0x72bd9178b14b6d51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066ef expref: 14 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732388:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832787.732397:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832787.732428:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732444:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732455:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732468:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732475:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.732481:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.733989:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.734215:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.734241:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832787.736436:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787832787.736470:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736482:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736491:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736498:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.736503:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736512:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736530:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:3.0:1787832787.736534:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787832787.736540:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736547:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b6e46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736582:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736589:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736608:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736613:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.736616:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736623:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736631:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3543a9cc00) 00010000:00010000:3.0:1787832787.736633:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.736637:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.736643:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87a00/0x72bd9178b14b6e38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832787.736657:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000693d7e8b reply state 00000000a6777ed4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832787.736668:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832787.737182:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:9682:x1874678282998784:12345-192.168.201.34@tcp:36:rm.0 Request processed in 5022us (5497us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787832787.737211:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00010000:00010000:3.0:1787832787.748231:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748256:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748293:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748300:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832787.748306:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748316:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748349:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c3543a9c500) 00010000:00010000:3.0:1787832787.748354:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832787.748360:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832787.748367:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b6e3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832788.683998:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832789.716279:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787832789.771939:0:6742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312800231931ns, next at 313800228862ns, rc = 0 00000100:00100000:1.0:1787832789.771970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832789.771995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300856320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832789.772108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832789.772261:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856320 00000100:00100000:3.0:1787832789.772272:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856320 00000100:00100000:3.0:1787832789.772342:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832789.772350:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300856320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832789.772395:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832789.772465:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300856320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832789.772473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787832789.772521:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb47c00 x1874678300856320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832789.772553:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300856320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787832789.772660:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832790.285511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832790.285553:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300856448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832790.285663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832790.285965:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856448 00000100:00100000:2.0:1787832790.285976:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856448 00000100:00100000:2.0:1787832790.286065:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787832790.286077:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300856448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832790.286141:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832790.286219:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300856448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832790.286252:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787832790.286547:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300856704:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832790.286612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787832790.286617:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300856576:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832790.286666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300857088:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832790.286744:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856704 00000100:00100000:3.0:1787832790.286748:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856704 00000100:00100000:3.0:1787832790.286779:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857088 00000100:00100000:3.0:1787832790.286781:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857088 00000100:00100000:3.0:1787832790.286799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787832790.286805:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300856704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286842:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300856704:12345-0@lo:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832790.286848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787832790.286859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787832790.286864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300857088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300857088:12345-0@lo:400:kworker.0 Request processed in 34us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832790.286904:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787832790.286921:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856576 00000100:00100000:3.0:1787832790.286924:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856576 00000100:00100000:3.0:1787832790.286945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787832790.286957:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300856576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.286985:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300856576:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832790.286992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787832790.287030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300856960:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832790.287077:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832790.287092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300856832:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832790.287134:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856960 00000100:00100000:3.0:1787832790.287137:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856960 00000100:00100000:3.0:1787832790.287173:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787832790.287179:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300856960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287208:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300856960:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832790.287214:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787832790.287432:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dd680 x1874678300856960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832790.287448:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300856960:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287473:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300856576:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287482:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300857088:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287490:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300856704:0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300856832 00000100:00100000:3.0:1787832790.287508:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300856832 00000100:00100000:3.0:1787832790.287535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832790.287540:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300856832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832790.287568:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300856832:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832790.287573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832790.287594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300856832:0@lo:400:kworker.0 00000100:00080000:1.0:1787832790.287788:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832790.287793:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787832790.290655:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357bb5ad00 x1874678300856448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832790.290744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300856448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787832790.744928:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832791.761828:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787832792.120790:0:11622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:2.0:1787832792.393129:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787832792.393196:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:2.0:1787832792.393312:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787832792.393318:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787832792.393751:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300857216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787832792.393858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832792.394473:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857216 00000100:00100000:1.0:1787832792.394483:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857216 00000100:00100000:1.0:1787832792.394578:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787832792.394589:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300857216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787832792.394624:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787832792.394672:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9029d4, atime: 0x6a9029d4, ctime: 0x6a9029d4, blocks: 0x1 00010000:00010000:1.0:1787832792.394681:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.394720:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1787832792.394726:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832792.394734:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.394755:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.394803:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.394811:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.394830:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1787832792.395567:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00080000:2.0:1787832792.395800:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832792.396998:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874678300857216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2405us (3132us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787832792.397013:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787832792.397060:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832792.397071:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.397086:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832792.397093:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.397107:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.397137:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.397145:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b6e4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832792.397189:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832792.397191:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832792.397193:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787832792.397464:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c357bb443c0/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787832792.397474:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300857216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787832792.570442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832792.570658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282998912 00000100:00100000:1.0:1787832792.570671:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282998912 00000100:00100000:1.0:1787832792.570774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:1.0:1787832792.570786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282998912:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832792.570889:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282998912:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 105us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832792.570896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 253 00000100:00100000:1.0:1787832792.571477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832792.571522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832792.571586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999040 00000100:00100000:3.0:1787832792.571593:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999040 00000100:00100000:3.0:1787832792.571663:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:3.0:1787832792.571672:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282999040:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832792.571950:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282999040:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 280us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832792.571959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00080000:1.0:1787832792.572101:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832792.572183:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999168 00000100:00100000:2.0:1787832792.572188:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999168 00000100:00100000:2.0:1787832792.572255:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1787832792.572264:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282999168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832792.572296:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678282999168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 34us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832792.572309:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00080000:1.0:1787832792.572518:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832792.574659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832792.574766:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999296 00000100:00100000:3.0:1787832792.574778:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999296 00000100:00100000:3.0:1787832792.574859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00080000:1.0:1787832792.574861:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832792.574869:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282999296:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832792.574966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678282999296:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832792.574974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00010000:00010000:3.0:1787832792.781453:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787832792.912353:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:3.0:1787832793.303565:0:11672:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf3f855c0 20000000:00000080:3.0:1787832793.303590:0:11672:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c356039f800 uarg=0000000000000000 20000000:01000000:3.0:1787832793.303636:0:11672:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787832793.303644:0:11672:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787832793.303650:0:11672:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787832793.304533:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787832793.305020:0:11672:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787832793.309759:0:11672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787832793.309833:0:11672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787832793.309891:0:11672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787832793.309914:0:11672:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787832793.309939:0:11672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.309962:0:11672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.309971:0:11672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.309979:0:11672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.309990:0:11672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.309996:0:11672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310004:0:11672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310080:0:11672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310319:0:11672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.310339:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857344:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832793.310538:0:11672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310548:0:11672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 12 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.310557:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857472:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832793.310590:0:11672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310599:0:11672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 18 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.310608:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857600:0@lo:104: 00000100:00100000:3.0:1787832793.310658:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787832793.310747:0:11672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310755:0:11672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 18 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.310778:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857728:0@lo:104: 00000100:00100000:3.0:1787832793.310804:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787832793.310826:0:11672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.310835:0:11672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 18 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.310843:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857856:0@lo:104: 00000100:00100000:3.0:1787832793.310866:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832793.310877:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546317300 going to sleep for 11 seconds 00000100:00100000:1.0:1787832793.310962:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787832793.310979:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857600 00000100:00100000:1.0:1787832793.310987:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857600 00000100:00100000:1.0:1787832793.311041:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857728 00000100:00100000:1.0:1787832793.311045:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857728 00000100:00100000:1.0:1787832793.311057:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857856 00000100:00100000:1.0:1787832793.311059:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857856 00000100:00100000:1.0:1787832793.311072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787832793.311082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+5:11672:x1874678300857600:12345-0@lo:104: 00010000:00010000:1.0:1787832793.311107:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311188:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832793.311195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+5:11672:x1874678300857600:12345-0@lo:104: Request processed in 116us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.311204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787832793.311222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832793.311239:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:11672:x1874678300857728:12345-0@lo:104: 00010000:00010000:1.0:1787832793.311247:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311278:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787832793.311283:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+4:11672:x1874678300857728:12345-0@lo:104: Request processed in 56us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.311289:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832793.311299:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832793.311305:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:11672:x1874678300857856:12345-0@lo:104: 00010000:00010000:1.0:1787832793.311312:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311340:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787832793.311345:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+3:11672:x1874678300857856:12345-0@lo:104: Request processed in 41us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.311352:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787832793.311398:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787832793.311405:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311424:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832793.311428:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311440:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832793.311448:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832793.311455:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787832793.311496:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311502:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832793.311526:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311533:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74d200/0x72bd9178b14b6d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311550:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787832793.311554:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311561:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74de00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832793.311564:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311581:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832793.311587:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832793.311593:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787832793.311606:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311613:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832793.311619:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311626:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6cfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6d04 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311635:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832793.311639:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311644:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832793.311647:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311654:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832793.311660:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832793.311672:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787832793.311687:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311693:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832793.311738:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311746:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74d600/0x72bd9178b14b6cef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b6cf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.311760:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832793.311762:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832793.311763:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832793.311770:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832793.311776:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832793.311799:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300857984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832793.311837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832793.311868:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832793.311873:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300858112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832793.311891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832793.311916:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300858240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832793.311944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832793.311975:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300857984 00000100:00100000:1.0:1787832793.311978:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300857984 00010000:00010000:1.0:1787832793.311999:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 19 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832793.312047:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858112 00000100:00100000:1.0:1787832793.312050:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858112 00010000:00010000:1.0:1787832793.312062:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 20 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832793.312071:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858240 00000100:00100000:1.0:1787832793.312073:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858240 00010000:00010000:1.0:1787832793.312083:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 21 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832793.312093:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832793.312099:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+21:3305:x1874678300857984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832793.312110:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832793.312114:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 21 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312124:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 21 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312144:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832793.312172:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+21:3305:x1874678300857984:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.312178:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787832793.312191:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832793.312196:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3305:x1874678300858112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832793.312203:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832793.312207:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 20 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312224:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 20 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312235:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832793.312254:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3305:x1874678300858112:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.312260:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832793.312272:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787832793.312277:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300858240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832793.312283:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832793.312287:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 19 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312295:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 19 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832793.312304:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832793.312324:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300858240:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832793.312329:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787832793.312396:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300858240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832793.312418:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300858112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832793.312425:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300857984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832793.313044:0:11672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031600/0x72bd9178b14b6d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6d0b expref: 18 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.313058:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857600:0@lo:104: 00010000:00010000:3.0:1787832793.313071:0:11672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540030a00/0x72bd9178b14b6d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6cfd expref: 17 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.313081:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857728:0@lo:104: 00010000:00010000:3.0:1787832793.313099:0:11672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540030800/0x72bd9178b14b6cf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b6cef expref: 16 pid: 5839 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832793.313108:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465ded00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857856:0@lo:104: 00000100:00100000:2.0:1787832793.317346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832793.317419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832793.317479:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857344:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832793.317493:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11672:1874678300857472:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832793.317539:0:11672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832793.317945:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999424 00000100:00100000:1.0:1787832793.317954:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999424 00010000:00010000:1.0:1787832793.318000:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 13 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832793.318098:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999552 00000100:00100000:1.0:1787832793.318102:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999552 00010000:00010000:1.0:1787832793.318119:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 14 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832793.318212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787832793.318224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+14:2353:x1874678282999424:12345-192.168.201.34@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787832793.318302:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1787832793.318313:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+14:2353:x1874678282999552:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832793.318332:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832793.318339:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 14 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832793.318352:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 14 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832793.318374:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86a00/0x72bd9178b14b6d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066da expref: 14 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832793.318392:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832793.318469:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678282999552:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 158us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832793.318478:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00010000:00010000:2.0:1787832793.320052:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832793.320067:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320087:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320318:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031000/0x72bd9178b14b6d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066e1 expref: 12 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320337:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320347:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320369:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320376:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320383:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320391:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320397:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832793.320402:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.320412:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.321311:0:11672:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832793.321326:0:11672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.322889:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.322925:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc87000/0x72bd9178b14b6e54 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832793.322949:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832793.323058:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:2353:x1874678282999424:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4830us (5722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832793.323072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00010000:00010000:1.0:1787832793.803863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832794.827934:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832794.875847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832794.877115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999680 00000100:00100000:3.0:1787832794.877129:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999680 00000100:00100000:3.0:1787832794.877275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:3.0:1787832794.877287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:5598:x1874678282999680:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.877308:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832794.877336:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b6e5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b70672e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.877372:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b6e5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70672e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.877387:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b6e5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70672e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.877398:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86200, rc 0) 00000100:00100000:3.0:1787832794.877602:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282999680:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 316us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.877611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 254 00000100:00100000:2.0:1787832794.885309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 10000000:01000000:1.0:1787832794.891824:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787832794.891834:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a1800 from 7 10000000:01000000:1.0:1787832794.891840:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832794.891906:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832794.891920:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832794.891933:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832794.891965:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832794.892088:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832794.892160:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098600 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.892272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999808 00000100:00100000:3.0:1787832794.892282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999808 00000100:00100000:3.0:1787832794.892337:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858368 00000100:00100000:3.0:1787832794.892340:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858368 00000100:00100000:0.0:1787832794.892359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:0.0:1787832794.892373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282999808:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.892374:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787832794.892380:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+16:5842:x1874678300858368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.892390:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832794.892407:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87a00/0x72bd9178b14b6e69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6e62 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.892431:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87a00/0x72bd9178b14b6e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6e62 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.892443:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87a00/0x72bd9178b14b6e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6e62 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.892454:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87a00, rc 0) 00000100:00100000:3.0:1787832794.892519:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300858368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.892525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787832794.892578:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.892594:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.892603:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832794.892663:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.892720:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832794.892729:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282999808:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 358us (7436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832794.892737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 255 00000100:00100000:3.0:1787832794.892738:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546317840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.892748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858496 00000100:00100000:3.0:1787832794.892751:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858496 00000100:00100000:3.0:1787832794.892777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787832794.892782:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300858496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.892920:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300858496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.892927:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787832794.892957:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.893070:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.893112:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832794.893133:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35491d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.893257:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858624 00000100:00100000:2.0:1787832794.893262:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858624 00000100:00100000:2.0:1787832794.893289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787832794.893295:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300858624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.893459:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300858624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.893466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787832794.893557:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300858624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.894311:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787832794.894326:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300858752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832794.894372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832794.894466:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858752 00000100:00100000:1.0:1787832794.894472:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858752 00000100:00100000:1.0:1787832794.894528:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787832794.894538:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300858752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832794.894586:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832794.894798:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300858752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 261us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832794.894817:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787832794.894855:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787832794.894861:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c357bb443c0, transno 4294967300 00000100:00100000:1.0:1787832794.894879:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300858752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787832794.895387:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832794.896063:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11685:1874678300858880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832794.896137:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832794.896183:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.896249:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300858880 00000100:00100000:2.0:1787832794.896255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300858880 00000100:00100000:2.0:1787832794.896338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787832794.896347:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:11685:x1874678300858880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832794.896584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:11685:x1874678300858880:12345-0@lo:502:llog_process_th.0 Request processed in 226us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.896604:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787832794.896720:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11685:1874678300858880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787832794.896751:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787832794.896763:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832794.896766:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787832794.896773:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c357b0a1800 00000020:00000080:1.0:1787832794.896776:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787832794.896869:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11685:1874678300859008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832794.896909:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832794.897338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832794.897481:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566098180 going to sleep for 11 seconds 00000100:00100000:0.0:1787832794.899812:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859008 00000100:00100000:0.0:1787832794.899827:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859008 00000100:00100000:0.0:1787832794.899870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678282999936 00000100:00100000:0.0:1787832794.899873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678282999936 00000100:00100000:0.0:1787832794.899892:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787832794.899901:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:11685:x1874678300859008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832794.900196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+17:11685:x1874678300859008:12345-0@lo:502:llog_process_th.0 Request processed in 295us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832794.900205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787832794.900248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:0.0:1787832794.900254:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282999936:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832794.900356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678282999936:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 100us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832794.900363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 261 00000100:00100000:0.0:1787832794.901104:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11685:1874678300859008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832794.901146:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832794.901155:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832794.901158:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787832794.901163:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787832794.901321:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787832794.901344:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787832794.901356:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832794.901369:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832794.901394:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787832794.901397:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357c687800 from 7 10000000:01000000:0.0:1787832794.901399:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787832794.901436:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832794.901445:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832794.901455:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832794.901477:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787832794.901525:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832794.901558:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.902894:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859136 00000100:00100000:3.0:1787832794.902907:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859136 00000100:00100000:3.0:1787832794.902968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787832794.902978:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+17:5842:x1874678300859136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.902998:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832794.903034:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b6e77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6e70 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.903067:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b6e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6e70 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.903080:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b6e77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6e70 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.903090:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86400, rc 0) 00000100:00100000:3.0:1787832794.903169:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.903187:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787832794.903325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832794.903348:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000064 00000100:00100000:3.0:1787832794.903352:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000064 00000100:00100000:3.0:1787832794.903370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 263 00000100:00100000:3.0:1787832794.903375:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:9952:x1874678283000064:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832794.903825:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:9952:x1874678283000064:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 447us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.903839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 263 00000100:00100000:3.0:1787832794.903891:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.903916:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.903928:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832794.904022:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.904061:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832794.904094:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546317840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.904108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859264 00000100:00100000:3.0:1787832794.904112:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859264 00000100:00100000:3.0:1787832794.904130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787832794.904141:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.904394:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.904410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787832794.904443:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.904475:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.904517:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832794.904532:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3544d52900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.904543:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859392 00000100:00100000:3.0:1787832794.904547:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859392 00000100:00100000:3.0:1787832794.904565:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787832794.904570:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832794.909719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5112us (5165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.909743:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787832794.913519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832794.914784:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.915106:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11688:1874678300859520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832794.915187:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787832794.927103:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787832794.930067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000192 00000100:00100000:3.0:1787832794.930087:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000192 00000100:00100000:3.0:1787832794.930172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859520 00000100:00100000:3.0:1787832794.930176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859520 00000100:00100000:3.0:1787832794.930216:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 266 00000100:00100000:3.0:1787832794.930229:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:9952:x1874678283000192:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832794.930812:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:9952:x1874678283000192:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 582us (17306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.930824:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 266 00000100:00100000:3.0:1787832794.930864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787832794.930872:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:11688:x1874678300859520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832794.931055:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:11688:x1874678300859520:12345-0@lo:502:llog_process_th.0 Request processed in 183us (15867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.931070:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787832794.931850:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.931909:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11688:1874678300859520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832794.931966:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832794.931983:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832794.931986:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787832794.931994:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c357c687800 00000020:00000080:2.0:1787832794.931997:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787832794.932128:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11688:1874678300859648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832794.932282:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832794.932326:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.932368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859648 00000100:00100000:2.0:1787832794.932374:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859648 00000100:00100000:2.0:1787832794.932419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787832794.932427:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:11688:x1874678300859648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832794.934997:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+18:11688:x1874678300859648:12345-0@lo:502:llog_process_th.0 Request processed in 2557us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.935029:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787832794.935910:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11688:1874678300859648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787832794.935959:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832794.935969:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832794.935971:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787832794.935976:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787832794.936728:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787832794.936759:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832794.936775:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.936804:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832794.936818:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832794.936821:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3543878800 from 7 10000000:01000000:2.0:1787832794.936824:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832794.936872:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.936881:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.936892:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832794.936919:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.936995:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832794.937051:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832794.937861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859776 00000100:00100000:3.0:1787832794.937872:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859776 00000100:00100000:3.0:1787832794.937932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787832794.937942:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:5842:x1874678300859776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832794.937960:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832794.937980:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b6e85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b6e7e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.938023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b6e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b6e7e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.938036:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b6e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b6e7e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832794.938046:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87400, rc 0) 00000100:00100000:3.0:1787832794.938113:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300859776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.938121:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787832794.939738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832794.939818:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832794.939850:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.939864:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832794.939953:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.940029:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832794.940063:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.940086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000320 00000100:00100000:2.0:1787832794.940092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000320 00000100:00100000:2.0:1787832794.940127:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300859904 00000100:00100000:2.0:1787832794.940130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300859904 00000100:00100000:2.0:1787832794.940146:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 270 00000100:00100000:2.0:1787832794.940155:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:5598:x1874678283000320:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832794.940170:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832794.940190:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706735 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832794.942383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787832794.942408:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300859904:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1787832794.943775:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706735 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.943796:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706735 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.943809:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d200, rc 0) 00000100:00100000:2.0:1787832794.943902:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678283000320:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 3746us (4173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.943914:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 270 00000100:00100000:1.0:1787832794.945008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300859904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2596us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832794.945021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787832794.946030:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300859904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.946115:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300860032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.946191:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832794.946300:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.946321:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860032 00000100:00100000:2.0:1787832794.946335:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860032 00000100:00100000:2.0:1787832794.946385:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787832794.946395:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300860032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.948350:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:5842:x1874678300860032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1946us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.948367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787832794.948501:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b844f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:204f2893-acc1-48f1-8f52-36a94d59ea17:5842:1874678300860032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832794.949847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832794.949977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000448 00000100:00100000:3.0:1787832794.949986:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000448 00000100:00100000:3.0:1787832794.950066:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 273 00000100:00100000:3.0:1787832794.950076:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678283000448:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832794.950502:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb46580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11691:1874678300860160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832794.951785:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832794.951839:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35432e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832794.951940:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860160 00000100:00100000:2.0:1787832794.951948:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860160 00000100:00100000:2.0:1787832794.952013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787832794.952024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:11691:x1874678300860160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832794.952759:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678283000448:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 2677us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.952772:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 273 00000100:00100000:2.0:1787832794.952986:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:11691:x1874678300860160:12345-0@lo:502:llog_process_th.0 Request processed in 963us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.952994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787832794.953384:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb46580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11691:1874678300860160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832794.953428:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832794.953441:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832794.953444:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787832794.953451:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3543878800 00000020:00000080:2.0:1787832794.953454:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787832794.954388:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11691:1874678300860288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832794.954472:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832794.954520:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35432e7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832794.958868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860288 00000100:00100000:1.0:1787832794.958888:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860288 00000100:00100000:1.0:1787832794.958970:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787832794.958982:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:11691:x1874678300860288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832794.959369:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:11691:x1874678300860288:12345-0@lo:502:llog_process_th.0 Request processed in 389us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832794.959379:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787832794.959471:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:204f2893-acc1-48f1-8f52-36a94d59ea17:11691:1874678300860288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787832794.959520:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832794.959531:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832794.959533:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787832794.959540:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787832794.960933:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787832794.960967:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832794.960984:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832794.961034:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832794.961835:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832794.962037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000576 00000100:00100000:2.0:1787832794.962048:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000576 00000100:00100000:2.0:1787832794.962115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 276 00000100:00100000:2.0:1787832794.962126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678283000576:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787832794.963520:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354371a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:5598:x1874678283000576:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 1385us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832794.963536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 276 00000100:00100000:1.0:1787832794.966543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832794.966636:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000704 00000100:00100000:3.0:1787832794.966649:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000704 00000100:00100000:3.0:1787832794.966745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:3.0:1787832794.966757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:9955:x1874678283000704:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832794.967045:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:9955:x1874678283000704:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 290us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.967055:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 277 00000100:00100000:1.0:1787832794.972584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832794.972755:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000832 00000100:00100000:3.0:1787832794.972769:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000832 00000100:00100000:3.0:1787832794.972836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 278 00000100:00100000:3.0:1787832794.972849:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:9955:x1874678283000832:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832794.973173:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:9955:x1874678283000832:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 326us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832794.973183:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 278 00000100:00100000:1.0:1787832795.404077:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300860544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832795.404186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832795.404270:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300860416:0@lo:400:kworker.0 00000100:00100000:3.0:1787832795.404290:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860544 00000100:00100000:3.0:1787832795.404301:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860544 00000100:00100000:1.0:1787832795.404312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832795.404350:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832795.404357:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300860672:0@lo:400:kworker.0 00000100:00100000:3.0:1787832795.404379:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787832795.404394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832795.404395:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300860544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832795.404435:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860672 00000100:00100000:1.0:1787832795.404440:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860672 00002000:00000024:3.0:1787832795.404446:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832795.404480:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787832795.404512:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300860544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832795.404521:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787832795.404623:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832795.405852:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300860672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832795.405935:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300860672:12345-0@lo:400:kworker.0 Request processed in 101us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832795.406735:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300860672:0@lo:400:kworker.0 00010000:00080000:2.0:1787832795.406757:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465de940 x1874678300860544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832795.406780:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300860544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832795.406837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860416 00000100:00100000:2.0:1787832795.406844:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860416 00000100:00100000:2.0:1787832795.406898:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787832795.406905:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300860416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832795.406967:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300860416:12345-0@lo:400:kworker.0 Request processed in 61us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832795.406974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787832795.407033:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300860416:0@lo:400:kworker.0 00000100:00100000:3.0:1787832795.411859:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300860800:0@lo:400:kworker.0 00000100:00100000:0.0:1787832795.411893:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300860928:0@lo:400:kworker.0 00000100:00100000:2.0:1787832795.411984:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832795.412011:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300861056:0@lo:400:kworker.0 00000100:00100000:1.0:1787832795.412094:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787832795.418477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832795.418577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860800 00000100:00100000:3.0:1787832795.418589:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860800 00000100:00100000:0.0:1787832795.419385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832795.419418:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787832795.419434:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300860800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832795.419451:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300860928 00000100:00100000:0.0:1787832795.419457:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300860928 00000100:00100000:0.0:1787832795.419496:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787832795.419517:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300860928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832795.419536:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300860800:12345-0@lo:400:kworker.0 Request processed in 107us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832795.419545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787832795.419568:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300860928:12345-0@lo:400:kworker.0 Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832795.419577:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787832795.419611:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300860800:0@lo:400:kworker.0 00000100:00100000:0.0:1787832795.419635:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300860928:0@lo:400:kworker.0 00000100:00080000:0.0:1787832795.419683:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832795.421866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832795.422405:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861056 00000100:00100000:3.0:1787832795.422417:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861056 00000100:00080000:0.0:1787832795.422657:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832795.422731:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787832795.422793:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300861056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832795.422905:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300861056:12345-0@lo:400:kworker.0 Request processed in 116us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832795.422914:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787832795.423072:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300861056:0@lo:400:kworker.0 00010000:00010000:1.0:1787832795.851943:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787832795.980414:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787832796.875937:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832797.695780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832797.695824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832797.695875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832797.695915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832797.695972:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001216 00000100:00100000:1.0:1787832797.695985:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001216 00000100:00100000:1.0:1787832797.696067:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1787832797.696080:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001216:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832797.696304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001088 00000100:00100000:0.0:1787832797.696309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001088 00000100:00100000:0.0:1787832797.696343:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001344 00000100:00100000:0.0:1787832797.696346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001344 00000100:00100000:0.0:1787832797.696367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787832797.696375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001088:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832797.696396:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283000960 00000100:00100000:2.0:1787832797.696400:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283000960 00000100:00100000:2.0:1787832797.696436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 280 00000100:00100000:2.0:1787832797.696443:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283000960:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832797.696557:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787832797.696567:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283001344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832797.703632:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001216:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 7534us (7695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832797.703652:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787832797.704090:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001088:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 7711us (8322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832797.704104:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00080000:0.0:1787832797.705167:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787832797.705177:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832797.709196:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283000960:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 12736us (13303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832797.709214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 280 00000100:00100000:3.0:1787832797.712616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283001344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 16021us (16761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832797.712638:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00010000:00010000:1.0:1787832797.899910:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832798.924643:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832799.947962:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832800.012096:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300861184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832800.012211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832800.012469:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861184 00000100:00100000:1.0:1787832800.012480:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861184 00000100:00100000:1.0:1787832800.012581:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787832800.012594:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300861184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832800.012642:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832800.012733:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300861184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832800.012767:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787832800.012829:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300861184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787832800.013280:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832800.525872:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832800.526019:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300861312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832800.526152:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832800.526747:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861312 00000100:00100000:2.0:1787832800.526763:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861312 00000100:00100000:2.0:1787832800.526875:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787832800.526888:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300861312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832800.526950:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832800.527025:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300861312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832800.527034:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787832800.527813:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465de580 x1874678300861312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832800.527846:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300861312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787832800.528625:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832800.528891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787832800.528979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832800.529024:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832800.529048:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300861568:0@lo:400:kworker.0 00000100:00100000:3.0:1787832800.529077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832800.529199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861696 00000100:00100000:0.0:1787832800.529206:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861696 00000100:00100000:0.0:1787832800.529271:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861568 00000100:00100000:0.0:1787832800.529274:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861568 00000100:00100000:0.0:1787832800.529295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787832800.529305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300861696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529366:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300861696:12345-0@lo:400:kworker.0 Request processed in 63us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832800.529382:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787832800.529420:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787832800.529426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300861568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300861568:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832800.529461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787832800.529490:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300861824:0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832800.529534:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832800.529540:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300861440:0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832800.529600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861824 00000100:00100000:0.0:1787832800.529604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861824 00000100:00100000:0.0:1787832800.529626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787832800.529632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300861824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300861824:12345-0@lo:400:kworker.0 Request processed in 30us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832800.529668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787832800.529734:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300861824:0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529768:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300861568:0@lo:400:kworker.0 00000100:00100000:0.0:1787832800.529793:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300861696:0@lo:400:kworker.0 00000100:00100000:2.0:1787832800.530803:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861440 00000100:00100000:2.0:1787832800.530814:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861440 00000100:00100000:2.0:1787832800.530870:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787832800.530879:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300861440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832800.530971:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300861440:12345-0@lo:400:kworker.0 Request processed in 93us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832800.530978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787832800.531126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300861440:0@lo:400:kworker.0 00000100:00080000:3.0:1787832800.531858:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832800.973525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832801.996091:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832802.811142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832802.811469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001472 00000100:00100000:2.0:1787832802.811501:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001472 00000100:00100000:2.0:1787832802.811578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 282 00000100:00100000:2.0:1787832802.811590:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283001472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832802.811685:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283001472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 97us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832802.811694:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 282 00000100:00100000:1.0:1787832802.817842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832802.817896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832802.817938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832802.818232:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001600 00000100:00100000:0.0:1787832802.818246:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001600 00000100:00100000:0.0:1787832802.818360:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001856 00000100:00100000:0.0:1787832802.818364:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001856 00000100:00100000:0.0:1787832802.818391:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787832802.818402:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832802.818504:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283001600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 104us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832802.818513:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787832802.818532:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:0.0:1787832802.818539:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283001856:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832802.818563:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283001856:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832802.818569:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00080000:1.0:1787832802.818895:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832802.819309:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001728 00000100:00100000:3.0:1787832802.819318:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001728 00000100:00100000:3.0:1787832802.819468:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1787832802.819478:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283001728:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832802.819538:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283001728:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 62us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832802.819545:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00080000:1.0:1787832802.821731:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787832803.020100:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832804.043889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832805.068781:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832805.132419:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832805.132445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543272d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300861952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832805.132547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832805.132911:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300861952 00000100:00100000:1.0:1787832805.132920:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300861952 00000100:00100000:1.0:1787832805.132997:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787832805.133007:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300861952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832805.133053:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832805.133102:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300861952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832805.133118:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787832805.133247:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832805.133528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543272d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300861952:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787832805.196426:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787832805.652683:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543273840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300862464:0@lo:400:kworker.0 00000100:00100000:1.0:1787832805.652783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832805.652877:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832805.652884:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543271a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300862336:0@lo:400:kworker.0 00000100:00100000:1.0:1787832805.652908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832805.653184:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35432703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300862080:0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832805.653257:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543270b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300862592:0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832805.653301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832805.653306:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35432712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300862208:0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832805.653354:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862592 00000100:00100000:2.0:1787832805.653361:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862592 00000100:00100000:2.0:1787832805.653416:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832805.653425:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653474:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300862592:12345-0@lo:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832805.653482:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832805.653504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862464 00000100:00100000:2.0:1787832805.653507:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862464 00000100:00100000:2.0:1787832805.653532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862336 00000100:00100000:2.0:1787832805.653535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862336 00000100:00100000:2.0:1787832805.653549:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862208 00000100:00100000:2.0:1787832805.653551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862208 00000100:00100000:2.0:1787832805.653565:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787832805.653584:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653619:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300862464:12345-0@lo:400:kworker.0 Request processed in 36us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832805.653625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787832805.653638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787832805.653645:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300862336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653673:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300862336:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832805.653678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787832805.653689:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787832805.653695:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300862208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.653748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300862208:12345-0@lo:400:kworker.0 Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832805.653753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1787832805.653778:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787832805.653782:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832805.653831:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35432712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300862208:0@lo:400:kworker.0 00010000:00080000:2.0:1787832805.653846:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3543270b40 x1874678300862592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832805.653858:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543270b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300862592:0@lo:400:kworker.0 00000100:00100000:2.0:1787832805.654186:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832805.654197:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832805.654226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832805.654309:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862720 00000100:00100000:0.0:1787832805.654314:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862720 00000100:00100000:0.0:1787832805.654350:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787832805.654357:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b847840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300862720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832805.654392:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832805.654443:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b847840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300862720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832805.654449:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787832805.654527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dfc00 x1874678300862720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832805.654544:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832805.655882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862080 00000100:00100000:1.0:1787832805.655894:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862080 00000100:00100000:1.0:1787832805.655945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787832805.655952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300862080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832805.656028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300862080:12345-0@lo:400:kworker.0 Request processed in 76us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832805.656035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787832805.656089:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543271a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300862336:0@lo:400:kworker.0 00000100:00100000:1.0:1787832805.656102:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543273840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300862464:0@lo:400:kworker.0 00000100:00100000:3.0:1787832805.657057:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35432703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300862080:0@lo:400:kworker.0 00010000:00010000:1.0:1787832806.091969:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832807.119948:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832807.934555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832807.934656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832807.935015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002112 00000100:00100000:2.0:1787832807.935025:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002112 00000100:00100000:2.0:1787832807.935164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:2.0:1787832807.935176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283002112:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:3.0:1787832807.935506:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832807.935615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283002112:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 441us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832807.935623:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1787832807.940010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283001984 00000100:00100000:0.0:1787832807.940024:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283001984 00000100:00100000:0.0:1787832807.940106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 284 00000100:00100000:0.0:1787832807.940116:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283001984:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832807.940208:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283001984:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 94us (5664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832807.940216:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 284 00000100:00100000:1.0:1787832807.954590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832807.957618:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002240 00000100:00100000:3.0:1787832807.957632:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002240 00000100:00100000:3.0:1787832807.957726:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1787832807.957738:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2351:x1874678283002240:12345-192.168.201.34@tcp:9:kworker.0 00000020:00000080:3.0:1787832807.958065:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6dc8 00000100:00080000:3.0:1787832807.958076:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c357c695000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787832807.958122:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1787832807.958130:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832807.958391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832807.958461:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+2:2351:x1874678283002240:12345-192.168.201.34@tcp:9:kworker.0 Request processed in 726us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832807.958472:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787832807.958549:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002368 00000100:00100000:1.0:1787832807.958554:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002368 00000100:00100000:1.0:1787832807.958592:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:1.0:1787832807.958599:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283002368:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:2.0:1787832807.958717:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787832807.958722:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832807.960425:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283002368:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 1816us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832807.960439:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00010000:00010000:1.0:1787832808.140215:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787832808.279294:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832808.279305:0:6720:0:(genops.c:885:class_export_put()) final put ffff8c3549730800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:2.0:1787832808.279377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3549730800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-OST0000 00000020:00000080:2.0:1787832808.279437:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357c695000 for lustre-OST0000 00010000:00010000:1.0:1787832809.163857:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832810.188137:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832810.252046:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832810.260594:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300862848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832810.260692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832810.260896:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862848 00000100:00100000:0.0:1787832810.260909:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862848 00000100:00100000:0.0:1787832810.260990:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787832810.261000:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b844b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300862848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787832810.261036:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832810.261099:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b844b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300862848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832810.261107:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787832810.261178:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543271680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300862848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787832810.261292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832810.763965:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b847c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300863104:0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.763995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b844780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787832810.764083:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b845680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300863360:0@lo:400:kworker.0 00000100:00100000:3.0:1787832810.764113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832810.764146:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300862976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832810.767952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832810.768049:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832810.768062:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b8470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300863616:0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.768125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832810.768187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863104 00000100:00100000:2.0:1787832810.768195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863104 00000100:00100000:2.0:1787832810.768264:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787832810.768273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.768320:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300863104:12345-0@lo:400:kworker.0 Request processed in 49us (4272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832810.768327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787832810.769819:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863616 00000100:00100000:2.0:1787832810.769829:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863616 00000100:00100000:2.0:1787832810.769893:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787832810.769902:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b845e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300863616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.769963:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b845e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300863616:12345-0@lo:400:kworker.0 Request processed in 62us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832810.769970:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787832810.769992:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787832810.770022:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b8470c0 x1874678300863616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832810.770035:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b8470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300863616:0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.770091:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863232 00000100:00100000:2.0:1787832810.770094:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863232 00000100:00100000:2.0:1787832810.770119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787832810.770125:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300863232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.770173:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300863232:12345-0@lo:400:kworker.0 Request processed in 48us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832810.770180:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787832810.770210:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b844780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787832810.771826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832810.771890:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863360 00000100:00100000:1.0:1787832810.771897:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863360 00000100:00100000:1.0:1787832810.771942:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787832810.771951:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300863360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832810.771995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300863360:12345-0@lo:400:kworker.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832810.772001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787832810.772020:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832810.772044:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b845680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300863360:0@lo:400:kworker.0 00000100:00100000:3.0:1787832810.772933:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b847c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300863104:0@lo:400:kworker.0 00000100:00100000:0.0:1787832810.774569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832810.774628:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300863488:0@lo:400:kworker.0 00000100:00100000:3.0:1787832810.774635:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300862976 00000100:00100000:3.0:1787832810.774642:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300862976 00000100:00100000:0.0:1787832810.774682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832810.774694:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787832810.774731:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300862976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832810.774790:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832810.774845:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300862976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832810.774853:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787832810.775006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863488 00000100:00100000:2.0:1787832810.775011:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863488 00000100:00100000:2.0:1787832810.775057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787832810.775064:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300863488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832810.775104:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300863488:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832810.775110:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:3.0:1787832810.775220:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dfc00 x1874678300862976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832810.775241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300862976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832810.775254:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300863488:0@lo:400:kworker.0 00000100:00080000:0.0:1787832810.775389:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832811.212020:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832812.235970:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832813.051198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832813.051260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832813.051303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832813.051388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002496 00000100:00100000:3.0:1787832813.051397:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002496 00000100:00100000:3.0:1787832813.051454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 286 00000100:00100000:3.0:1787832813.051464:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678283002496:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832813.051532:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678283002496:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 69us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832813.051540:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 286 00000100:00100000:1.0:1787832813.051679:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002752 00000100:00100000:1.0:1787832813.051694:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002752 00000100:00100000:1.0:1787832813.051775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002624 00000100:00100000:1.0:1787832813.051778:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002624 00000100:00100000:1.0:1787832813.051795:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787832813.051801:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678283002752:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832813.051854:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2355:x1874678283002752:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832813.051861:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787832813.051873:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:1.0:1787832813.051889:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678283002624:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832813.051914:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678283002624:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832813.051920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00080000:3.0:1787832813.052034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832813.261868:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832814.295043:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832815.311469:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832815.372032:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832815.372066:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300863744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832815.372170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832815.372261:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863744 00000100:00100000:3.0:1787832815.372279:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863744 00000100:00100000:3.0:1787832815.372356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787832815.372368:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300863744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832815.372417:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832815.372473:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300863744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832815.372482:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787832815.372511:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832815.372562:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300863744:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787832815.438336:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787832815.885929:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832815.886068:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300863872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832815.886170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832815.887041:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300864128:0@lo:400:kworker.0 00000100:00100000:3.0:1787832815.887094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832815.887128:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832815.887134:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300864256:0@lo:400:kworker.0 00000100:00100000:3.0:1787832815.887159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832815.887373:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864128 00000100:00100000:2.0:1787832815.887399:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864128 00000100:00100000:2.0:1787832815.887463:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864256 00000100:00100000:2.0:1787832815.887466:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864256 00000100:00100000:2.0:1787832815.887505:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787832815.887515:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300864128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887584:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300864128:12345-0@lo:400:kworker.0 Request processed in 69us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832815.887592:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787832815.887611:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787832815.887618:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300864256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887658:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300864256:12345-0@lo:400:kworker.0 Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832815.887665:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787832815.887684:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832815.887764:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887777:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300864128:0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887813:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300864000:0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832815.887876:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832815.887882:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300864384:0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.887904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832815.887928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864000 00000100:00100000:2.0:1787832815.887932:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864000 00000100:00100000:2.0:1787832815.888152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787832815.888160:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300864000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.888215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300864000:12345-0@lo:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832815.888231:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787832815.888265:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864384 00000100:00100000:2.0:1787832815.888269:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864384 00000100:00100000:2.0:1787832815.888296:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787832815.888302:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b844780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300864384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.888344:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b844780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300864384:12345-0@lo:400:kworker.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832815.888350:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1787832815.888366:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832815.888384:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300864384:0@lo:400:kworker.0 00000100:00100000:2.0:1787832815.888393:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300864000:0@lo:400:kworker.0 00000100:00100000:0.0:1787832815.893901:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300863872 00000100:00100000:0.0:1787832815.893920:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300863872 00000100:00100000:0.0:1787832815.895206:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787832815.895223:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300863872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832815.895279:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832815.895408:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300863872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (9237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832815.895416:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787832815.895476:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3543271e00 x1874678300863872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832815.895502:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300863872:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787832815.897199:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787832816.332077:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832817.355946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787832817.906480:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:13:36 (1787832816) 00000100:00100000:2.0:1787832818.180877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832818.180936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832818.180970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832818.181005:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003136 00000100:00100000:2.0:1787832818.181017:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003136 00000100:00100000:2.0:1787832818.181091:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003008 00000100:00100000:2.0:1787832818.181094:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003008 00000100:00100000:2.0:1787832818.181120:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:2.0:1787832818.181131:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283003136:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832818.181229:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283003136:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832818.181240:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:2.0:1787832818.181261:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1787832818.181268:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283003008:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832818.181311:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283003008:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832818.181319:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00080000:2.0:1787832818.181344:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832818.183358:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283002880 00000100:00100000:3.0:1787832818.183376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283002880 00000100:00100000:3.0:1787832818.183468:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 288 00000100:00100000:3.0:1787832818.183479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283002880:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832818.183564:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283002880:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 86us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832818.183573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 288 00010000:00010000:1.0:1787832818.380200:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832819.403922:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832819.447921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832819.448385:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003264 00000100:00100000:0.0:1787832819.448398:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003264 00000100:00100000:0.0:1787832819.448519:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832819.448533:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:10225:x1874678283003264:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832819.448564:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832819.448625:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b6e93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70673c expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.448881:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.448901:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.448919:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832819.449219:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787832819.449225:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832819.449339:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.449374:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b6e93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70673c expref: 7 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.449396:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70673c expref: 6 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832819.449406:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832819.449410:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832819.449414:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832819.449514:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:10225:x1874678283003264:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 983us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832819.449524:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832819.459438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832819.459540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003392 00000100:00100000:2.0:1787832819.459554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003392 00000100:00100000:2.0:1787832819.459638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:2.0:1787832819.459652:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:10226:x1874678283003392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832819.460389:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832819.460430:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6ea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706743 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460525:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460543:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460559:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460589:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460598:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.460604:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.462566:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.462602:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.462615:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832819.462759:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787832819.462764:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832819.464599:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464626:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464633:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464641:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464649:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832819.464653:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464663:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.464681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832819.466446:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832819.466462:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466474:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466502:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466510:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466519:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466525:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832819.466529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466538:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466556:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832819.466559:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832819.466562:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466568:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6eaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466648:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6ea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706743 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466732:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706743 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.466741:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3547ea9d00) 00010000:00010000:2.0:1787832819.466743:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832819.466746:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74ce00, rc 0) 00000100:00100000:2.0:1787832819.466863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:10226:x1874678283003392:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 7212us (7443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832819.466874:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:1.0:1787832819.470030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832819.470179:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003648 00000100:00100000:2.0:1787832819.470193:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003648 00000100:00100000:2.0:1787832819.470269:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1787832819.470283:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:10226:x1874678283003648:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832819.470316:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832819.470346:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6ebd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70674a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470461:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470495:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470556:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470590:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.470598:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471515:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6ed2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471529:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471540:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832819.471552:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787832819.471882:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471891:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471899:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471905:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74da00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832819.471910:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471919:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3547ea9d00) 00010000:00010000:2.0:1787832819.471950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832819.471957:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471964:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6ec4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471979:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471986:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471992:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.471997:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832819.472000:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472006:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472013:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c3547ea9000) 00010000:00010000:2.0:1787832819.472015:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832819.472018:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472025:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6ecb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472590:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b6ebd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70674a expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472611:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70674a expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832819.472619:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:2.0:1787832819.472621:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832819.472624:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d000, rc 0) 00000100:00100000:2.0:1787832819.472777:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10226:x1874678283003648:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2496us (2761us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787832819.472788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787832819.481287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832819.481509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003776 00000100:00100000:3.0:1787832819.481524:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003776 00000100:00100000:3.0:1787832819.481627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1787832819.481641:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10226:x1874678283003776:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787832819.482150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10226:x1874678283003776:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 510us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832819.482162:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000040:00080000:1.0:1787832819.533222:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787832820.450399:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832820.503948:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832820.503981:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300864512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832820.504103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832820.504215:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864512 00000100:00100000:2.0:1787832820.504530:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864512 00000100:00100000:2.0:1787832820.504625:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787832820.504637:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300864512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787832820.504671:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787832820.504689:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832820.510023:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300864512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5372us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832820.510026:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300864512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832820.510042:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787832821.005022:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300864640:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300865152:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005432:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787832821.005439:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300864768:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005483:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300865280:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005579:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300864896:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005628:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832821.005633:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300865024:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.005657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.005697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864640 00000100:00100000:0.0:1787832821.006113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864640 00000100:00100000:0.0:1787832821.006253:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787832821.006266:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300864640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.006343:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300864640:12345-0@lo:400:kworker.0 Request processed in 79us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.006351:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787832821.006397:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300865152 00000100:00100000:0.0:1787832821.006402:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300865152 00000100:00100000:0.0:1787832821.006444:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864768 00000100:00100000:0.0:1787832821.006448:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864768 00000100:00100000:0.0:1787832821.006463:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300864896 00000100:00100000:0.0:1787832821.006465:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300864896 00000100:00100000:0.0:1787832821.006481:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787832821.006487:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300865152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.006520:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300865152:12345-0@lo:400:kworker.0 Request processed in 34us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.006526:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787832821.006538:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787832821.006557:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300864768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.006585:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300864768:12345-0@lo:400:kworker.0 Request processed in 41us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.006599:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787832821.006610:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787832821.006616:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300864896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.006651:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300864896:12345-0@lo:400:kworker.0 Request processed in 36us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.006657:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787832821.006683:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300865280 00000100:00100000:0.0:1787832821.006686:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300865280 00000100:00100000:0.0:1787832821.006740:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300865024 00000100:00100000:0.0:1787832821.007829:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300865024 00000100:00100000:0.0:1787832821.008133:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787832821.008144:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300865280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832821.008286:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832821.008306:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35432730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300865408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832821.008375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832821.008508:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300865280:12345-0@lo:400:kworker.0 Request processed in 366us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.008516:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787832821.008534:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787832821.008540:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300865024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.008585:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300865024:12345-0@lo:400:kworker.0 Request processed in 45us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.008592:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787832821.008664:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300864768:0@lo:400:kworker.0 00010000:00080000:0.0:1787832821.008681:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3558b65e00 x1874678300865280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787832837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832821.008693:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300865280:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.008741:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300864640:0@lo:400:kworker.0 00000100:00100000:1.0:1787832821.008850:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300865408 00000100:00100000:1.0:1787832821.008930:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300865408 00000100:00100000:1.0:1787832821.008975:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787832821.008984:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300865408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832821.009023:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832821.009210:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300865408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832821.009219:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787832821.009318:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35432730c0 x1874678300865408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832821.009336:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35432730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300865408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832821.010032:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300865152:0@lo:400:kworker.0 00000100:00080000:0.0:1787832821.010234:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832821.010241:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832821.010275:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300865024:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.010291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300864896:0@lo:400:kworker.0 00000100:00100000:0.0:1787832821.451255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.451354:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283003904 00000100:00100000:3.0:1787832821.451368:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283003904 00000100:00100000:3.0:1787832821.451475:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1787832821.451488:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10268:x1874678283003904:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832821.451519:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832821.451561:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6ee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706751 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451869:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451891:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451908:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451937:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451945:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.451952:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.452360:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.452371:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.452379:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.452387:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832821.452393:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.452403:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787832821.452535:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787832821.452988:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832821.453278:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832821.453284:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832821.453292:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453302:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453323:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453329:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453335:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453339:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832821.453343:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453348:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453357:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3543a9c700) 00010000:00010000:3.0:1787832821.453359:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832821.453362:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453367:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6eee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453520:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6ee0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706751 expref: 10 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453533:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832821.453545:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832821.453556:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6ee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706751 expref: 10 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.453567:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87800, rc 0) 00000100:00100000:3.0:1787832821.453979:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10268:x1874678283003904:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2490us (2737us total) trans 0 rc 301/301 00000100:00100000:3.0:1787832821.453991:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787832821.460655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.460896:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004160 00000100:00100000:0.0:1787832821.460910:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004160 00000100:00100000:0.0:1787832821.460990:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1787832821.461001:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10268:x1874678283004160:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:0.0:1787832821.461095:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832821.461133:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6e9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70673c expref: 9 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.461154:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832821.461167:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832821.462592:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.462623:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.462639:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.462656:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.462671:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.462677:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832821.463958:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787832821.463978:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464079:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464087:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464094:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832821.464100:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464110:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464132:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3542b1f700) 00010000:00010000:0.0:1787832821.464136:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832821.464141:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.464148:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6ef5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832821.464187:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000791fe8ae reply state 00000000a15bfab7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.464199:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832821.464364:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:10268:x1874678283004160:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 3357us (3717us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787832821.464376:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:1.0:1787832821.469318:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469338:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469346:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469353:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832821.469359:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469368:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469392:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832821.469396:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832821.469402:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.469434:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6efc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832821.546544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.546883:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004288 00000100:00100000:3.0:1787832821.546902:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004288 00000100:00100000:2.0:1787832821.547025:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1787832821.547039:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10276:x1874678283004288:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:2.0:1787832821.547081:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832821.547109:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706758 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547204:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547218:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547229:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832821.547301:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787832821.547304:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832821.547352:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547377:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706758 expref: 11 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547394:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706758 expref: 10 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.547401:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832821.547404:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832821.547407:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d800, rc 0) 00000100:00100000:2.0:1787832821.547517:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:10276:x1874678283004288:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 482us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832821.547523:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:3.0:1787832821.583004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.583090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004416 00000100:00100000:0.0:1787832821.583104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004416 00000100:00100000:0.0:1787832821.583237:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787832821.583250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:10282:x1874678283004416:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832821.583286:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832821.583313:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70675f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583408:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583439:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583454:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583480:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583507:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583902:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583913:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.583922:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832821.583967:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787832821.583972:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832821.584025:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584040:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584046:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584054:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584060:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832821.584064:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584072:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584096:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:0.0:1787832821.584100:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832821.584105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584113:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b6f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584131:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584137:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584142:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584151:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832821.584153:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584160:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584167:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3542b1f700) 00010000:00010000:0.0:1787832821.584169:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832821.584172:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584179:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b6f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584928:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b6f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70675f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584954:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70675f expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.584963:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832821.584965:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787832821.584968:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031e00, rc 0) 00000100:00100000:3.0:1787832821.585164:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:10282:x1874678283004416:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1914us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832821.585177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787832821.589237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.589546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004672 00000100:00100000:3.0:1787832821.589559:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004672 00000100:00100000:3.0:1787832821.589833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1787832821.589848:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:10282:x1874678283004672:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832821.589877:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832821.589905:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706766 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.590092:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.590111:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.590125:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.591283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.591311:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.591326:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832821.592108:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787832821.597035:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597062:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597077:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597802:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597812:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597819:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597825:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832821.597830:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597857:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597875:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832821.597878:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832821.597883:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.597890:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832821.597909:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001707e845 reply state 0000000066c9e9b7 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832821.597919:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787832821.597974:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.598190:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.598200:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:3.0:1787832821.598203:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832821.598206:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:3.0:1787832821.598301:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10282:x1874678283004672:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8457us (9079us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787832821.598311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:1.0:1787832821.603949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.605494:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004800 00000100:00100000:0.0:1787832821.605514:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004800 00000100:00100000:0.0:1787832821.605612:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787832821.605624:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678283004800:12345-192.168.201.34@tcp:8:bash.0 00010000:00080000:0.0:1787832821.605668:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:0.0:1787832821.605762:0:6695:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b6f50 00002000:00100000:0.0:1787832821.605781:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436/ffff8c354828b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787832821.605796:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787832821.606133:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787832821.606179:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c354828d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832821.606289:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678283004800:12345-192.168.201.34@tcp:8:bash.0 Request processed in 665us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.606299:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00010000:00010000:2.0:1787832821.607478:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607522:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607530:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607549:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832821.607555:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607565:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607589:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9c600) 00010000:00010000:2.0:1787832821.607593:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832821.607611:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.607619:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.616439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832821.616824:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283004928 00000100:00100000:2.0:1787832821.616839:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283004928 00000100:00100000:2.0:1787832821.616998:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787832821.617011:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678283004928:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787832821.617037:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832821.617068:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70676d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787832821.617146:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787832821.617173:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787832821.617178:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832821.617190:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.617216:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.617235:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74dc00, rc 0) 00000100:00100000:2.0:1787832821.617334:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283004928:12345-192.168.201.34@tcp:101:bash.0 Request processed in 326us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832821.617342:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00080000:0.0:1787832821.617750:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832821.620377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.620454:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283005056 00000100:00100000:0.0:1787832821.620469:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283005056 00000100:00100000:0.0:1787832821.622582:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1787832821.622622:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:10282:x1874678283005056:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832821.622652:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832821.622686:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706774 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.622759:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.622771:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832821.622777:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832821.622784:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.622842:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.622860:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 8 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.622878:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874678300865536:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832821.623206:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55480 going to sleep for 11 seconds 00000100:00100000:1.0:1787832821.630445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832821.630628:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283005184 00000100:00100000:2.0:1787832821.630641:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283005184 00010000:00010000:2.0:1787832821.630759:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 9 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832821.630809:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1787832821.630821:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283005184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832821.630843:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832821.630877:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 9 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.630922:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 9 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.630960:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832821.630966:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832821.630978:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.630991:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.631056:0:8455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832821.631074:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8455:1874678300865664:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787832821.631383:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35589b5900 going to sleep for 11 seconds 00010000:00010000:0.0:1787832821.632057:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de65d9a/0x72bd9178b14b6f57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70676d expref: 9 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.632107:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874678300865536:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832821.632145:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.632160:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832821.632211:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:10282:x1874678283005056:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9613us (11848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.632223:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787832821.637245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.637320:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283005440 00000100:00100000:3.0:1787832821.637351:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283005440 00000100:00100000:3.0:1787832821.637440:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787832821.637452:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10282:x1874678283005440:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787832821.638042:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10282:x1874678283005440:12345-192.168.201.34@tcp:35:bash.0 Request processed in 590us (809us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787832821.638052:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787832821.639354:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8455:1874678300865664:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787832821.639388:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832821.639467:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283005184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 8647us (9037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832821.639480:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1787832821.726088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832821.726186:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283005696 00000100:00100000:2.0:1787832821.726197:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283005696 00000100:00100000:2.0:1787832821.726267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787832821.726278:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10292:x1874678283005696:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832821.726336:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832821.726368:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6f65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70677b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832821.726861:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787832821.727042:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6f65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70677b expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.727062:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832821.727065:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832821.727072:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6f65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70677b expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.727090:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c800, rc 0) 00000100:00100000:2.0:1787832821.727238:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10292:x1874678283005696:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 961us (1162us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787832821.727248:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787832821.733842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.733939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283005952 00000100:00100000:3.0:1787832821.733952:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283005952 00000100:00100000:3.0:1787832821.734036:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832821.734051:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10292:x1874678283005952:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832821.734440:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:10292:x1874678283005952:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 391us (611us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787832821.734450:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:1.0:1787832821.815331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832821.815544:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006080 00000100:00100000:2.0:1787832821.815557:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006080 00000100:00100000:2.0:1787832821.815902:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1787832821.815915:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:10298:x1874678283006080:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832821.816017:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832821.816046:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706782 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816139:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816174:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816189:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832821.816271:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787832821.816275:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832821.816304:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816340:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706782 expref: 18 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816362:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706782 expref: 17 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.816372:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832821.816459:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832821.816464:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d600, rc 0) 00000100:00100000:2.0:1787832821.817495:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10298:x1874678283006080:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1570us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832821.817512:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:2.0:1787832821.829725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.830287:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006336 00000100:00100000:3.0:1787832821.830301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006336 00000100:00100000:3.0:1787832821.830492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1787832821.830505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b844f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10298:x1874678283006336:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832821.830543:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832821.830572:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6f81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706789 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.830873:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.830893:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.830907:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832821.831028:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787832821.831209:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6f81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706789 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.831231:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706789 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.831239:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:3.0:1787832821.831242:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832821.831246:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87c00, rc 0) 00000100:00100000:3.0:1787832821.831468:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b844f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10298:x1874678283006336:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 964us (1784us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787832821.831478:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787832821.842999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832821.843060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.843135:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006592 00000100:00100000:3.0:1787832821.843149:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006592 00000100:00100000:3.0:1787832821.843234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787832821.843246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10298:x1874678283006592:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832821.843286:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832821.843317:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706790 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.843491:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.843511:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.843554:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832821.843572:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787832821.844025:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706790 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.844047:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706790 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.844057:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:3.0:1787832821.844061:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787832821.844065:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832821.844144:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10298:x1874678283006592:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 900us (1082us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787832821.844153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1787832821.848813:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006720 00000100:00100000:2.0:1787832821.848834:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006720 00000100:00100000:2.0:1787832821.848965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1787832821.848979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:2352:x1874678283006720:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832821.849027:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832821.849064:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b6f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706789 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.849093:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:2.0:1787832821.849100:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832821.849191:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2352:x1874678283006720:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 214us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832821.849199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1787832821.854969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.855130:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006848 00000100:00100000:0.0:1787832821.855144:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006848 00000100:00100000:0.0:1787832821.855219:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1787832821.855231:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283006848:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1787832821.855290:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.855316:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.855325:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832821.855330:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832821.855335:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.855470:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.855509:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.855527:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300865792:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832821.855837:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832821.858806:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300865792:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832821.858847:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832821.861302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832821.862009:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283006976 00000100:00100000:0.0:1787832821.862030:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283006976 00002000:00100000:0.0:1787832821.862107:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c356579e580 x1874678283006976/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:382/0 lens 504/0 e 0 to 0 dl 1787832832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832821.862120:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c356579e580 with x1874678283006976 ext(0->12) 00010000:00010000:0.0:1787832821.862131:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 8 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.862148:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 8 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787832821.862157:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c356579e580 00000100:00100000:0.0:1787832821.862205:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832821.862217:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283006976:12345-192.168.201.34@tcp:4:lfs.0 00000001:00100000:1.0:1787832821.942986:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000001:00080000:3.0:1787832821.986056:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787832821.986298:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283006976:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 124072us (124997us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787832821.986322:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:2.0:1787832821.986340:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c356579e580 x1874678283006976/t4294967299(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:382/0 lens 504/448 e 0 to 0 dl 1787832832 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787832821.986353:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c356579e580 with x1874678283006976 ext(0->12) 00010000:00010000:2.0:1787832821.986367:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832821.986390:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787832821.986399:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c356579e580 00000100:00100000:3.0:1787832821.989204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832821.989309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283007104 00000100:00100000:1.0:1787832821.989321:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283007104 00010000:00010000:1.0:1787832821.989372:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832821.989422:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787832821.989434:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283007104:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832821.989455:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787832821.989480:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787832821.989482:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787832822 00002000:00010000:1.0:1787832821.989484:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787832822 00002000:00010000:1.0:1787832821.989486:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787832822 00002000:00010000:1.0:1787832821.989502:0:5831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787832821.989508:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.989521:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.989565:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b6f5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706774 expref: 7 pid: 6695 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.989596:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787832821.989602:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832821.989608:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.989620:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832821.989659:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832821.989858:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283007104:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 426us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832821.989868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00010000:00010000:0.0:1787832821.990159:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990173:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990207:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990217:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990224:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990233:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832821.990239:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990251:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990269:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832821.990279:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c6db9de/0x72bd9178b14b6fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832821.990377:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283006848:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 135147us (135423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832821.990387:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1787832821.998009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832821.998125:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283007360 00000100:00100000:3.0:1787832821.998139:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283007360 00000100:00100000:3.0:1787832821.998249:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787832821.998263:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10298:x1874678283007360:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:3.0:1787832821.998348:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706790 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832821.998799:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787832821.998866:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787832821.999665:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787832821.999799:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.999822:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.999833:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.999883:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832821.999904:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 24 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832821.999922:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300865920:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832822.000061:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565b57b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832822.005055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832822.005160:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283007488 00000100:00100000:1.0:1787832822.005171:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283007488 00010000:00010000:1.0:1787832822.005225:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 25 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832822.005355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:1.0:1787832822.005367:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b846580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:2352:x1874678283007488:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832822.005389:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832822.005398:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 25 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.005415:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 25 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.005448:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:1.0:1787832822.005454:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.005466:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.005475:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.005499:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832822.005589:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b846580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:2352:x1874678283007488:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 223us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832822.005605:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00010000:00010000:3.0:1787832822.005798:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706766 expref: 24 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832822.005821:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300865920:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832822.005850:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.005862:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.005867:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832822.006078:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787832822.006333:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787832822.006471:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300866048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787832822.006781:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832822.006836:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3547fc8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832822.008265:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300866048 00000100:00100000:0.0:1787832822.008286:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300866048 00000100:00100000:0.0:1787832822.008362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832822.008375:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300866048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787832822.008523:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300866048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 150us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832822.008543:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832822.008681:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300866048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787832822.010216:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787832822.010348:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b847c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300866176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787832822.010431:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832822.010519:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832822.011086:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300866176 00000100:00100000:0.0:1787832822.011096:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300866176 00000100:00100000:0.0:1787832822.011160:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832822.011171:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b845680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300866176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787832822.011519:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b845680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874678300866176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 349us (1086us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787832822.011539:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832822.011780:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b847c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300866176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787832822.011864:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787832822.012094:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012107:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012116:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012124:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832822.012130:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012139:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012159:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:2.0:1787832822.012163:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787832822.012169:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.012177:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b6fb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787832822.012407:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787832822.012883:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787832822.013028:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345041325029ns, next at 346041322115ns, rc = 0 00000001:00080000:2.0:1787832822.013038:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787832822.013087:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9c700) 00010000:00010000:2.0:1787832822.013091:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787832822.013102:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b6f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706790 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832822.013246:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10298:x1874678283007360:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 14985us (15364us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787832822.013258:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000020:00080000:2.0:1787832822.013263:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787832822.016298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.016403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283007616 00000100:00100000:0.0:1787832822.016416:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283007616 00000100:00100000:0.0:1787832822.016542:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1787832822.016555:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10298:x1874678283007616:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832822.016603:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832822.016635:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b6fb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706797 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.016795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b6fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706797 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.016813:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b6fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706797 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.016837:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832822.016840:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787832822.016845:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:0.0:1787832822.016933:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10298:x1874678283007616:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 381us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832822.016941:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787832822.022450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.022574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283007872 00000100:00100000:3.0:1787832822.022587:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283007872 00000100:00100000:2.0:1787832822.023185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787832822.023203:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af68850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10298:x1874678283007872:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832822.023680:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af68850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10298:x1874678283007872:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 480us (1243us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787832822.023934:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787832822.087316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.087579:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283008128 00000100:00100000:0.0:1787832822.087594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283008128 00000100:00100000:0.0:1787832822.088013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1787832822.088027:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10308:x1874678283008128:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832822.088060:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832822.089048:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70679e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832822.089231:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787832822.089404:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6fc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70679e expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.089422:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:0.0:1787832822.089426:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832822.089451:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b6fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70679e expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.089473:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:0.0:1787832822.089589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10308:x1874678283008128:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1565us (2466us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787832822.089599:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1787832822.094177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.094286:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283008256 00000100:00100000:3.0:1787832822.094300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283008256 00000100:00100000:3.0:1787832822.094393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1787832822.094406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10308:x1874678283008256:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1787832822.094514:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.094544:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.094559:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.094580:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.094586:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.094593:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095031:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095067:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832822.095124:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095139:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095146:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095152:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095159:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832822.095164:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095171:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095185:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832822.095188:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832822.095193:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b6fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095221:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095227:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095232:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095237:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832822.095240:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095245:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095252:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832822.095254:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832822.095256:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095261:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b6fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095277:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095284:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095290:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095301:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832822.095305:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095311:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095320:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832822.095322:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832822.095325:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.095331:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b6fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832822.096427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10308:x1874678283008256:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 2012us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832822.096443:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1787832822.101514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.101615:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283008512 00000100:00100000:3.0:1787832822.101633:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283008512 00000100:00100000:3.0:1787832822.101752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787832822.101774:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10308:x1874678283008512:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832822.102415:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:10308:x1874678283008512:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 640us (915us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787832822.102426:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787832822.142047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832822.142447:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283008768 00000100:00100000:2.0:1787832822.142461:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283008768 00000100:00100000:2.0:1787832822.142550:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832822.142562:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:10311:x1874678283008768:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832822.142607:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832822.142634:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6fe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067a5 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143023:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143042:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143055:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143071:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143077:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143084:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143250:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143259:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143266:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832822.143276:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787832822.143397:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143416:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143422:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143428:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832822.143432:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143441:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143454:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832822.143457:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832822.143462:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143468:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b6fea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143485:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143491:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143497:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143502:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832822.143511:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143518:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143542:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3547ea9700) 00010000:00010000:2.0:1787832822.143545:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832822.143548:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.143554:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b6ff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.144076:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b6fe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 34 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.144097:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 33 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.144105:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832822.144108:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832822.144112:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c400, rc 0) 00000100:00100000:2.0:1787832822.144250:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10311:x1874678283008768:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1689us (2218us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787832822.144261:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:1.0:1787832822.152481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832822.153144:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283008896 00000100:00100000:2.0:1787832822.153158:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283008896 00000100:00100000:2.0:1787832822.153238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:2.0:1787832822.153252:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10311:x1874678283008896:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787832822.153358:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153380:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153394:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153430:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153438:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153446:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153452:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832822.153457:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153465:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153479:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832822.153483:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832822.153489:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.153495:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832822.153979:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10311:x1874678283008896:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 727us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832822.153989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1787832822.157074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.157196:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283009152 00000100:00100000:3.0:1787832822.157208:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283009152 00000100:00100000:3.0:1787832822.157280:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787832822.157310:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10311:x1874678283009152:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832822.158028:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:10311:x1874678283009152:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 716us (964us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787832822.158038:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832822.414248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.414373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283009408 00000100:00100000:0.0:1787832822.414386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283009408 00000100:00100000:0.0:1787832822.414461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787832822.414470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:10342:x1874678283009408:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787832822.414499:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832822.414533:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b700d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067ac expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.414662:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.414677:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.414688:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832822.414880:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787832822.415603:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b700d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ac expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.415634:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ac expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.415660:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832822.415663:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832822.415667:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832822.415833:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10342:x1874678283009408:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1362us (1656us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787832822.415844:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1787832822.419562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832822.422497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.422563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283009792 00000100:00100000:0.0:1787832822.422576:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283009792 00000100:00100000:2.0:1787832822.422904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283009664 00000100:00100000:2.0:1787832822.422911:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283009664 00000100:00100000:0.0:1787832822.422926:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787832822.422938:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:2352:x1874678283009792:12345-192.168.201.34@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787832822.422941:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787832822.422947:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:10342:x1874678283009664:12345-192.168.201.34@tcp:35:cat.0 00010000:00010000:0.0:1787832822.422960:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832822.422994:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ac expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.423020:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832822.423027:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832822.423119:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:2352:x1874678283009792:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 183us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832822.423128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:2.0:1787832822.423827:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10342:x1874678283009664:12345-192.168.201.34@tcp:35:cat.0 Request processed in 875us (4274us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787832822.423836:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00010000:00010000:1.0:1787832822.478773:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832822.529191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.529327:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010048 00000100:00100000:3.0:1787832822.529342:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010048 00000100:00100000:3.0:1787832822.529476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:3.0:1787832822.529489:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10348:x1874678283010048:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:3.0:1787832822.529549:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832822.529553:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787832822.529601:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b6f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706782 expref: 36 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529626:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832822.529633:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832822.529651:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7022 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067b3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529857:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529874:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 36 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529884:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529930:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 36 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.529971:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 36 pid: 10395 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832822.529989:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300866304:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832822.530563:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354639a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787832822.536842:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300866304:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832822.536887:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832822.542469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.543413:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010176 00000100:00100000:0.0:1787832822.543430:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010176 00010000:00010000:0.0:1787832822.543491:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 37 pid: 10395 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832822.543609:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:0.0:1787832822.543643:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:2352:x1874678283010176:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832822.543665:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832822.543674:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 37 pid: 10395 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543691:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 37 pid: 10395 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543745:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b6ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067a5 expref: 37 pid: 10395 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543769:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832822.543775:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543787:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543796:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.543851:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832822.543949:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:2352:x1874678283010176:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 308us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832822.543958:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00010000:00010000:3.0:1787832822.544919:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.544935:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832822.544961:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787832822.545217:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7022 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.545239:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.545258:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832822.545262:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787832822.545266:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87800, rc 0) 00000100:00100000:3.0:1787832822.545348:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10348:x1874678283010048:12345-192.168.201.34@tcp:101:dd.0 Request processed in 15861us (16173us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787832822.545378:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:1.0:1787832822.550516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832822.550647:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010432 00000100:00100000:2.0:1787832822.550663:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010432 00000100:00100000:2.0:1787832822.550777:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787832822.550791:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10348:x1874678283010432:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1787832822.551939:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.551968:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.551982:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832822.552230:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787832822.552441:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebe7485c reply state 00000000721914a5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832822.552475:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832822.552865:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:10348:x1874678283010432:12345-192.168.201.34@tcp:36:dd.0 Request processed in 2072us (2361us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787832822.552875:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000020:00080000:2.0:1787832822.552881:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787832822.556685:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557431:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557441:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557448:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832822.557454:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557465:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557489:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:1.0:1787832822.557493:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832822.557499:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.557507:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7037 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832822.745962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832822.746248:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010560 00000100:00100000:2.0:1787832822.746261:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010560 00000100:00100000:2.0:1787832822.746374:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787832822.746385:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:10362:x1874678283010560:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:2.0:1787832822.746428:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832822.746455:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b703e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067ba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746572:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746602:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746618:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746643:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746650:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746847:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746860:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746881:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746926:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.746943:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 39 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832822.746960:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300866432:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832822.747127:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832822.751506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.752160:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010816 00000100:00100000:3.0:1787832822.752172:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010816 00000100:00100000:3.0:1787832822.752252:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:3.0:1787832822.752265:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:5595:x1874678283010816:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787832822.753008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:5595:x1874678283010816:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 742us (1515us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787832822.753019:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832822.755450:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300866432:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832822.755489:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832822.756114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832822.756234:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283010944 00000100:00100000:2.0:1787832822.756244:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283010944 00010000:00010000:2.0:1787832822.756291:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 41 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832822.756379:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787832822.756391:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:2352:x1874678283010944:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832822.756422:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832822.756431:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 41 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756456:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 41 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756483:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7029 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067b3 expref: 41 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756503:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832822.756509:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756530:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756539:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.756576:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832822.756653:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:2352:x1874678283010944:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 264us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832822.756661:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00010000:00010000:1.0:1787832822.758175:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758193:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832822.758259:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787832822.758264:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832822.758326:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758346:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758357:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758364:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758371:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758377:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74dc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832822.758382:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758391:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758422:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832822.758425:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832822.758448:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758476:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758483:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758489:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758495:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832822.758499:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758505:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758522:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3547ea9700) 00010000:00010000:1.0:1787832822.758525:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832822.758529:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b704c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758598:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b703e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ba expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758626:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ba expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832822.758634:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:1.0:1787832822.758637:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832822.758640:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74da00, rc 0) 00000100:00100000:1.0:1787832822.758946:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:10362:x1874678283010560:12345-192.168.201.34@tcp:101:stat.0 Request processed in 12561us (12995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832822.758956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1787832822.835576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832822.835750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283011200 00000100:00100000:0.0:1787832822.835763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283011200 00000100:00100000:0.0:1787832822.835848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1787832822.835861:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:10368:x1874678283011200:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:0.0:1787832822.835947:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832822.835986:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067ba expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.836012:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832822.836019:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832822.836306:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.836325:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832822.836337:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832822.836397:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787832822.836425:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf2dbe1 reply state 00000000b6cebf5a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832822.836436:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832822.836634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:10368:x1874678283011200:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 774us (1073us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787832822.836643:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000020:00080000:0.0:1787832822.836649:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787832822.849904:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.849929:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.849938:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.849971:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832822.849977:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.849987:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.850009:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832822.850013:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832822.850019:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832822.850026:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b705a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832822.996383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832822.996502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283011328 00000100:00100000:3.0:1787832822.996528:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283011328 00000100:00100000:3.0:1787832822.996612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787832822.996624:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:10382:x1874678283011328:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1787832822.996656:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832822.996737:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996825:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996843:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996875:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996904:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.996911:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997030:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997039:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997045:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832822.997086:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787832822.997090:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832822.997117:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997137:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997143:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997150:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997165:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832822.997170:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997178:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997194:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832822.997198:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832822.997203:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997209:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997226:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997232:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997240:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997245:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832822.997248:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997254:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997271:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832822.997273:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832822.997276:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997283:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b706f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997339:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832822.997347:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832822.997349:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832822.997352:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832822.997967:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:10382:x1874678283011328:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1342us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832822.997977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1787832823.118765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.118896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283011584 00000100:00100000:3.0:1787832823.118911:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283011584 00000100:00100000:3.0:1787832823.119006:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:3.0:1787832823.119020:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:10392:x1874678283011584:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832823.119097:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832823.119336:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b707d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067c8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787832823.120431:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787832823.120610:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787832823.122078:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b707d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c8 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.122106:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832823.122110:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832823.122117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b707d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c8 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.122133:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832823.122222:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+42:10392:x1874678283011584:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 3204us (3470us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787832823.122233:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000001:00080000:2.0:1787832823.128201:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:2.0:1787832823.128268:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787832823.128297:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c344259ce40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787832823.128304:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c344259cf00 00000020:00080000:2.0:1787832823.128308:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c355ed07400 00000020:00080000:0.0:1787832823.128469:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787832823.128651:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787832823.129070:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832823.129100:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300866560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787832823.129216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832823.130990:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300866560 00000100:00100000:1.0:1787832823.131010:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300866560 00000100:00100000:1.0:1787832823.131134:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832823.131155:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300866560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787832823.131202:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787832823.131256:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9029f6, atime: 0x6a9029f6, ctime: 0x6a9029f6, blocks: 0xb 00010000:00010000:1.0:1787832823.131267:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.131290:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1787832823.131295:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832823.131303:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.131328:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.131364:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.131375:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.131407:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787832823.131599:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832823.134880:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874678300866560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3715us (5645us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787832823.134904:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787832823.135571:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832823.135586:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.135603:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832823.135608:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.135624:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.135657:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.135690:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004db1ade5/0x72bd9178b14b708b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.135755:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832823.135757:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832823.135759:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787832823.136204:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c356579de00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787832823.136215:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300866560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787832823.139018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.141757:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283011840 00000100:00100000:3.0:1787832823.141778:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283011840 00000100:00100000:3.0:1787832823.141881:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787832823.141895:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:10392:x1874678283011840:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832823.143022:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10392:x1874678283011840:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1122us (4013us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787832823.143036:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832823.222491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832823.222808:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012096 00000100:00100000:1.0:1787832823.222823:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012096 00000100:00100000:1.0:1787832823.222953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1787832823.222967:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10398:x1874678283012096:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832823.223006:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832823.223038:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7092 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067cf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.223208:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.223228:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.223239:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.223312:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.223329:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832823.223348:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300866688:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832823.223489:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832823.235364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832823.235533:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300866688:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832823.235634:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832823.238317:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012224 00000100:00100000:3.0:1787832823.238339:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012224 00010000:00010000:2.0:1787832823.238517:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 15 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832823.238669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:2.0:1787832823.238682:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:2353:x1874678283012224:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832823.238798:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832823.238808:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 15 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.238826:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 15 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.238856:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067c1 expref: 15 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.238877:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832823.238884:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.238895:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.238904:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.240756:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832823.240885:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283012224:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2196us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832823.240900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00010000:00010000:1.0:1787832823.245670:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.245692:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832823.246444:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787832823.246910:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7092 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.246941:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832823.246951:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:1.0:1787832823.246955:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832823.246977:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41c00, rc 0) 00000100:00100000:1.0:1787832823.247133:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10398:x1874678283012096:12345-192.168.201.34@tcp:101:bash.0 Request processed in 24168us (24653us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787832823.247145:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832823.257699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832823.257947:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012480 00000100:00100000:0.0:1787832823.257962:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012480 00000100:00100000:0.0:1787832823.258101:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787832823.258115:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10398:x1874678283012480:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1787832823.258906:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.258933:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.258949:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832823.259016:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787832823.259047:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e5d3c16 reply state 000000001d35a0df transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832823.259058:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832823.259579:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10398:x1874678283012480:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1463us (1893us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787832823.259591:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000020:00080000:0.0:1787832823.259614:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787832823.266697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.266818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012608 00000100:00100000:3.0:1787832823.266832:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012608 00000100:00100000:3.0:1787832823.266911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1787832823.266925:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10398:x1874678283012608:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832823.266960:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832823.266989:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267108:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267149:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267157:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267164:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267202:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267234:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.267261:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 18 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832823.267279:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300866816:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832823.267391:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832823.270796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.270897:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012736 00000100:00100000:2.0:1787832823.270908:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012736 00010000:00010000:2.0:1787832823.270959:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 19 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832823.271006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787832823.271016:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2352:x1874678283012736:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832823.271037:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832823.271045:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 19 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.271063:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 19 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.271092:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832823.271099:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.271109:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.271115:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.271122:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832823.271200:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2352:x1874678283012736:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 185us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832823.271208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00010000:00010000:3.0:1787832823.271941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067cf expref: 18 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832823.271962:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300866816:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832823.271991:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274081:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274101:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274109:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274115:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832823.274121:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274129:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274153:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832823.274156:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832823.274160:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274171:0:3292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274419:0:3292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274530:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.274538:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b70a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.274679:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.274866:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832823.274945:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787832823.274951:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832823.274981:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.275037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067d6 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.275057:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067d6 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.275065:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832823.275068:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832823.275070:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832823.275354:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:10398:x1874678283012608:12345-192.168.201.34@tcp:101:bash.0 Request processed in 8430us (8681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.275366:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1787832823.281973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.282101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283012992 00000100:00100000:2.0:1787832823.282132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283012992 00000100:00100000:2.0:1787832823.282390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787832823.282404:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:10398:x1874678283012992:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1787832823.282983:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10398:x1874678283012992:12345-192.168.201.34@tcp:35:bash.0 Request processed in 579us (1026us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787832823.282994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787832823.295815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.295876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.295916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832823.296016:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283013120 00000100:00100000:1.0:1787832823.296029:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283013120 00000100:00100000:1.0:1787832823.296103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 290 00000100:00100000:1.0:1787832823.296115:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283013120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832823.296219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283013120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832823.296228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 290 00000100:00100000:0.0:1787832823.296452:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283013248 00000100:00100000:0.0:1787832823.296459:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283013248 00000100:00100000:0.0:1787832823.296536:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1787832823.296545:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283013248:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832823.296596:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283013248:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 53us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832823.296603:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1787832823.297024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283013376 00000100:00100000:3.0:1787832823.297030:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283013376 00000100:00100000:3.0:1787832823.297118:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:3.0:1787832823.297127:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283013376:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832823.297185:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283013376:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 48us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.297192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00080000:1.0:1787832823.297747:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832823.297755:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832823.396998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832823.397168:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283013632 00000100:00100000:0.0:1787832823.397227:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283013632 00000100:00100000:0.0:1787832823.397306:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:0.0:1787832823.397319:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10409:x1874678283013632:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832823.397361:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832823.397392:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b70bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067dd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832823.398110:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787832823.398360:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b70bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067dd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.398377:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:0.0:1787832823.398380:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832823.398385:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b70bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067dd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.398402:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832823.398615:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10409:x1874678283013632:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1296us (1630us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787832823.398637:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1787832823.401251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.401313:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283013760 00000100:00100000:3.0:1787832823.401323:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283013760 00000100:00100000:3.0:1787832823.401390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787832823.401403:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10409:x1874678283013760:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1787832823.401844:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.401868:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.401880:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.401898:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.401903:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.401907:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402292:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402299:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402304:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832823.402355:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402376:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402381:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402386:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402390:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.402394:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402400:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402411:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832823.402413:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.402419:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402422:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402432:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402436:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402440:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402447:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.402449:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402452:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402456:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9ce00) 00010000:00010000:3.0:1787832823.402458:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.402459:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402462:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402475:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402478:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402481:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402494:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.402496:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402501:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402527:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832823.402529:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.402533:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.402539:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832823.402644:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10409:x1874678283013760:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1242us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.402653:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832823.404671:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.404891:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283014016 00000100:00100000:3.0:1787832823.404904:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283014016 00000100:00100000:3.0:1787832823.404977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787832823.404991:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10409:x1874678283014016:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832823.405516:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10409:x1874678283014016:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 525us (852us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787832823.405525:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787832823.433413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.433587:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283014272 00000100:00100000:3.0:1787832823.433600:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283014272 00000100:00100000:3.0:1787832823.433681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1787832823.433693:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10412:x1874678283014272:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832823.433773:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832823.433802:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433905:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433944:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433958:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433982:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.433996:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434473:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b70f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434483:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b70f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434491:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b70f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832823.434516:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787832823.434644:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434652:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434659:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434671:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.434676:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434684:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434698:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832823.434804:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.434811:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b70e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434832:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434843:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434849:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434854:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.434857:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434864:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434882:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9ce00) 00010000:00010000:3.0:1787832823.434885:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.434889:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434895:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b70ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434950:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b70df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067e4 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434967:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b70f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067e4 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.434975:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832823.434978:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832823.434980:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86800, rc 0) 00000100:00100000:3.0:1787832823.435133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10412:x1874678283014272:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1440us (1735us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787832823.435143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1787832823.437846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.437889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.437992:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283014528 00000100:00100000:3.0:1787832823.438004:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283014528 00000100:00100000:3.0:1787832823.438080:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1787832823.438092:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10412:x1874678283014528:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1787832823.438182:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438204:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438237:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438273:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438281:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438288:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438294:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.438299:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438308:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438323:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:3.0:1787832823.438325:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832823.438331:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.438337:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832823.438428:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10412:x1874678283014528:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 337us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.438437:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1787832823.438605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283014400 00000100:00100000:0.0:1787832823.438611:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283014400 00000100:00100000:0.0:1787832823.438659:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787832823.438668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:2355:x1874678283014400:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832823.438683:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832823.438735:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b70f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067e4 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.438748:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832823.438752:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832823.438776:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2355:x1874678283014400:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 111us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832823.438783:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787832823.442081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.442202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283014784 00000100:00100000:2.0:1787832823.442214:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283014784 00000100:00100000:2.0:1787832823.442292:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:2.0:1787832823.442304:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10412:x1874678283014784:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832823.442945:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10412:x1874678283014784:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 638us (874us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787832823.442956:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00010000:00010000:0.0:1787832823.500090:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832823.606648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832823.606925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015040 00000100:00100000:0.0:1787832823.606941:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015040 00000100:00100000:0.0:1787832823.607027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:0.0:1787832823.607041:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10430:x1874678283015040:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787832823.607078:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832823.607105:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067eb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.607253:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7110 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.607271:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.607305:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7110 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832823.607320:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787832823.608017:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067eb expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.608062:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7110 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067eb expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832823.608072:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:0.0:1787832823.608075:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787832823.608079:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832823.610471:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10430:x1874678283015040:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1130us (1536us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787832823.610519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:0.0:1787832823.648270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.648467:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015168 00000100:00100000:3.0:1787832823.648480:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015168 00000100:00100000:3.0:1787832823.648576:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:3.0:1787832823.648587:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10431:x1874678283015168:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832823.648621:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832823.648645:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b711e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067f2 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.648777:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.648797:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.648812:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832823.649074:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787832823.649079:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832823.649175:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.649208:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b711e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f2 expref: 25 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.649227:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f2 expref: 24 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.649237:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832823.649240:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832823.649251:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86a00, rc 0) 00000100:00100000:3.0:1787832823.649332:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10431:x1874678283015168:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 747us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.649341:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787832823.656304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.656460:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015552 00000100:00100000:3.0:1787832823.656475:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015552 00000100:00100000:3.0:1787832823.656560:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1787832823.656578:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10431:x1874678283015552:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832823.657058:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10431:x1874678283015552:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 480us (766us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787832823.657067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832823.660607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832823.661615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015680 00000100:00100000:2.0:1787832823.661631:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015680 00000100:00100000:2.0:1787832823.662528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:2.0:1787832823.662549:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10431:x1874678283015680:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:2.0:1787832823.662584:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787832823.662624:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b70b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067d6 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.662672:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7110 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067eb expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.662753:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b6fb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706797 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832823.662769:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fa00) 00010000:00010000:2.0:1787832823.662781:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832823.662860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:10431:x1874678283015680:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 321us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832823.662868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832823.665134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.665353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015808 00000100:00100000:3.0:1787832823.665366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015808 00000100:00100000:3.0:1787832823.665437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1787832823.665448:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:10431:x1874678283015808:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1787832823.665622:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.665646:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.665661:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832823.667350:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832823.667580:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787832823.667638:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787832823.667990:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:10431:x1874678283015808:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 2536us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.668017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:0.0:1787832823.682020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832823.682123:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283015936 00000100:00100000:3.0:1787832823.682133:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283015936 00000100:00100000:3.0:1787832823.682264:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:3.0:1787832823.682276:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:10433:x1874678283015936:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832823.682306:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832823.682336:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7067f9 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682459:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682474:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682484:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682496:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682514:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.682521:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.684951:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.684982:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.684992:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832823.685638:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787832823.685644:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832823.685670:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685692:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685830:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685836:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685842:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685846:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.685850:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685856:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685867:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832823.685879:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.685884:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685889:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b713a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685902:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685906:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685910:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685913:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832823.685914:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685917:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685921:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832823.685923:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832823.685924:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685927:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685971:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 24 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685991:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 23 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832823.685997:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:3.0:1787832823.685998:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832823.686000:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832823.686645:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10433:x1874678283015936:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 4366us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832823.686656:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:1.0:1787832824.523777:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787832824.581454:0:12006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832824.581786:0:12006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832824.581837:0:12006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787832824.581846:0:12006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787832824.655851:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787832824.655866:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787832824.657053:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787832824.657067:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787832824.657268:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300866944:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832824.657413:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db780 going to sleep for 11 seconds 00000100:00100000:1.0:1787832824.660201:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300866944:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787832824.667471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832824.667941:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016064 00000100:00100000:1.0:1787832824.667955:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016064 00000100:00100000:1.0:1787832824.668027:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832824.668052:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016064:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787832824.668179:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016064:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 130us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.668188:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832824.671356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832824.671455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016192 00000100:00100000:2.0:1787832824.671467:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016192 00000100:00100000:2.0:1787832824.671547:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:2.0:1787832824.671565:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016192:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787832824.671604:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787832824.672276:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016192:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 710us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832824.672287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1787832824.688726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832824.688787:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016320 00000100:00100000:1.0:1787832824.688800:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016320 00000100:00100000:1.0:1787832824.688875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1787832824.688886:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016320:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787832824.690093:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.690117:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.690131:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.690148:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.690661:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.690670:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691087:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691099:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691107:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832824.691805:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787832824.691812:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832824.691840:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691857:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691865:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691874:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691880:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832824.691884:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691901:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691917:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:1.0:1787832824.691920:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832824.691925:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b714f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691945:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691951:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691957:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691962:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832824.691965:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691971:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.691978:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8c3543c5aa00) 00010000:00010000:1.0:1787832824.691981:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832824.691984:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692001:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7156 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692019:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692025:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692032:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692088:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832824.692091:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692097:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692105:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:1.0:1787832824.692107:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832824.692110:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.692116:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b715d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832824.692243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016320:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 3353us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.692256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:1.0:1787832824.697651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832824.697739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016576 00000100:00100000:0.0:1787832824.697754:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016576 00000100:00100000:0.0:1787832824.697826:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1787832824.697837:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10445:x1874678283016576:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832824.697867:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832824.697893:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7164 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706800 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698066:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698085:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698099:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832824.698112:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787832824.698376:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698386:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698394:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698402:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832824.698407:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698416:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698431:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:0.0:1787832824.698435:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832824.698442:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698458:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b716b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698529:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7164 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706800 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698555:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:0.0:1787832824.698559:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832824.698564:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7164 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706800 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.698575:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832824.698670:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283016576:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 835us (1036us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787832824.698680:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1787832824.701542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.701640:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016704 00000100:00100000:3.0:1787832824.701653:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016704 00000100:00100000:3.0:1787832824.701761:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:3.0:1787832824.701773:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283016704:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787832824.701828:0:10395:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787832824.701996:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283016704:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 224us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832824.702005:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1787832824.710342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.710846:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283016960 00000100:00100000:3.0:1787832824.710860:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283016960 00000100:00100000:3.0:1787832824.710954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1787832824.710967:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283016960:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832824.711006:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832824.711010:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787832824.711248:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f2 expref: 24 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.711278:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832824.711285:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832824.711302:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7179 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706807 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832824.715881:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787832824.719086:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7180 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.719116:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.719133:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.720337:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7179 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706807 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.720361:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706807 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.720372:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832824.720375:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832824.720400:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832824.720515:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10445:x1874678283016960:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 9549us (10183us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787832824.720527:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1787832824.733897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.733944:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017216 00000100:00100000:3.0:1787832824.733956:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017216 00000100:00100000:3.0:1787832824.734023:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:3.0:1787832824.734034:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10445:x1874678283017216:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832824.734112:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832824.736815:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7180 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706807 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736856:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832824.736874:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832824.736908:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736926:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736940:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736958:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736965:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.736986:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740261:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740883:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740891:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740898:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832824.740903:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740911:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740935:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832824.740939:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832824.740945:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740951:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b718e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740969:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740975:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740991:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.740997:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832824.741000:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.741006:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.741015:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7a7c8c87 (ffff8c3543a9c700) 00010000:00010000:3.0:1787832824.741017:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832824.741020:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.741026:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7195 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7a7c8c87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832824.744767:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283017216:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 10714us (10865us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832824.744785:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1787832824.751414:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832824.751653:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017344 00000100:00100000:1.0:1787832824.751667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017344 00000100:00100000:1.0:1787832824.751782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1787832824.751794:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10445:x1874678283017344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832824.751821:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832824.751865:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b719c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70680e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.751909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.751927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.751942:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.752079:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b719c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.752103:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.752112:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:1.0:1787832824.752115:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787832824.752119:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40a00, rc 0) 00000100:00100000:1.0:1787832824.752209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10445:x1874678283017344:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 417us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.752225:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:1.0:1787832824.765087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832824.765213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017600 00000100:00100000:0.0:1787832824.765227:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017600 00000100:00100000:0.0:1787832824.765313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:0.0:1787832824.765326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:10445:x1874678283017600:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787832824.765445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.765466:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.765507:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832824.765941:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787832824.765953:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347794249584ns, next at 348794246886ns, rc = 0 00000004:00010000:0.0:1787832824.766070:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c22496 reply state 000000006d4ddc27 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832824.766080:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832824.766221:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10445:x1874678283017600:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 896us (1149us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787832824.766230:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:2.0:1787832824.771514:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771539:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771556:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771588:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832824.771594:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771602:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771644:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832824.771648:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787832824.771655:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832824.771661:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b71aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832824.775441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.775669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017728 00000100:00100000:3.0:1787832824.775691:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017728 00000100:00100000:3.0:1787832824.775819:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1787832824.775833:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:10445:x1874678283017728:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832824.775871:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832824.775901:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706815 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.776015:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.776032:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832824.776057:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:3.0:1787832824.776060:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832824.776066:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86800, rc 0) 00000100:00100000:3.0:1787832824.776144:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10445:x1874678283017728:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 315us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832824.776320:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1787832824.781601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.782415:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017856 00000100:00100000:3.0:1787832824.782431:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017856 00000100:00100000:3.0:1787832824.782521:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1787832824.782533:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678283017856:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787832824.782591:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:3.0:1787832824.782658:0:6695:0:(genops.c:1385:class_connect()) connect: client fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436, cookie 0x72bd9178b14b71b8 00002000:00100000:3.0:1787832824.782690:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436/ffff8c3550cf8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787832824.782753:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787832824.783080:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787832824.783136:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c3550cfa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787832824.784555:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2351:x1874678283017856:12345-192.168.201.34@tcp:8:lhsmtool_posix.0 Request processed in 2004us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832824.784584:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1787832824.797140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832824.809874:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283017984 00000100:00100000:2.0:1787832824.809896:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283017984 00000100:00100000:2.0:1787832824.810031:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:2.0:1787832824.810045:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:0:x1874678283017984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787832824.810500:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832824.863596:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:0:x1874678283017984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 53539us (66457us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787832824.863614:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:3.0:1787832824.867530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832824.867696:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283018240 00000100:00100000:0.0:1787832824.867741:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283018240 00000100:00100000:0.0:1787832824.867819:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832824.867843:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10445:x1874678283018240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787832824.868167:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10445:x1874678283018240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 337us (652us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787832824.868176:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000001:00080000:1.0:1787832824.869260:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787832824.869283:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000100:00100000:1.0:1787832824.880935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.883667:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283018496 00000100:00100000:3.0:1787832824.885104:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283018496 00000100:00100000:1.0:1787832824.891750:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1787832824.891771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10445:x1874678283018496:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787832824.891945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10445:x1874678283018496:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 179us (11023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.891953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:0.0:1787832824.898560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.898908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283018624 00000100:00100000:3.0:1787832824.898920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283018624 00000100:00100000:0.0:1787832824.899056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:0.0:1787832824.899070:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:10445:x1874678283018624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832824.899110:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832824.899138:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b71bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70681c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899249:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899268:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899283:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832824.899334:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832824.899359:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899395:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b71bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70681c expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899418:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70681c expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.899427:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:0.0:1787832824.899430:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787832824.899434:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832824.899533:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10445:x1874678283018624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 467us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832824.899553:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1787832824.909298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832824.909530:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283018752 00000100:00100000:1.0:1787832824.909542:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283018752 00000100:00100000:1.0:1787832824.911879:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1787832824.911895:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2355:x1874678283018752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832824.911921:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832824.911947:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706823 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787832824.911982:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9029f9, blocks: 0x1 00010000:00010000:1.0:1787832824.912007:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1787832824.912012:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832824.912032:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.912055:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.912071:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832824.912625:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678283018752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 731us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.912635:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:3.0:1787832824.926316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.926367:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019008 00000100:00100000:3.0:1787832824.926381:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019008 00000100:00100000:3.0:1787832824.926456:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1787832824.926469:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10445:x1874678283019008:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787832824.926639:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10445:x1874678283019008:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 172us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832824.926649:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:1.0:1787832824.938850:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832824.939844:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019136 00000100:00100000:1.0:1787832824.939863:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019136 00000100:00100000:1.0:1787832824.939967:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:1.0:1787832824.939983:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:10445:x1874678283019136:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832824.940011:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832824.940045:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70682a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.940091:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.940103:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832824.940108:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832824.940127:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.940205:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.940225:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 7 pid: 6697 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832824.940245:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b3ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300867072:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832824.940378:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db780 going to sleep for 11 seconds 00000100:00100000:3.0:1787832824.946803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832824.946892:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019264 00000100:00100000:0.0:1787832824.946904:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019264 00010000:00010000:0.0:1787832824.946960:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 8 pid: 6697 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832824.947013:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1787832824.947028:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283019264:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832824.947049:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832824.947078:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 8 pid: 6697 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.947096:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 8 pid: 6697 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.947133:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832824.947140:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832824.947160:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.947174:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832824.947225:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832824.947243:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1874678300867200:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787832824.947324:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b71cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706823 expref: 8 pid: 6697 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832824.947344:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b3ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300867072:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832824.947383:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832824.947395:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40600, rc 0) 00000100:00100000:0.0:1787832824.951420:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832824.954894:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b846580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1874678300867200:192.168.201.34@tcp:105: 00010000:00010000:0.0:1787832824.954933:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832824.955104:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283019264:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 8077us (8315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832824.955118:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787832824.956005:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:10445:x1874678283019136:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 16020us (17166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832824.956017:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832824.959817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832824.959870:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019392 00000100:00100000:0.0:1787832824.959885:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019392 00002000:00100000:0.0:1787832824.959958:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c357b846580 x1874678283019392/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:385/0 lens 504/0 e 0 to 0 dl 1787832835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832824.959970:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b846580 with x1874678283019392 ext(0->8) 00002000:00010000:0.0:1787832824.959977:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b846580 00000100:00100000:0.0:1787832824.960055:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832824.960077:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283019392:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787832824.961456:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283019392:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 1374us (1786us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787832824.961488:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:3.0:1787832824.961501:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c357b846580 x1874678283019392/t4294967302(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:385/0 lens 504/448 e 0 to 0 dl 1787832835 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832824.961512:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b846580 with x1874678283019392 ext(0->8) 00002000:00010000:3.0:1787832824.961519:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b846580 00000100:00100000:0.0:1787832824.965366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832824.965438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019520 00000100:00100000:3.0:1787832824.965456:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019520 00000100:00100000:3.0:1787832824.965620:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1787832824.965637:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10445:x1874678283019520:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787832825.023090:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1787832825.023120:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787832825.023152:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1787832825.023204:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787832825.023218:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787832825.023449:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10445:x1874678283019520:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 57810us (58086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832825.023462:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1787832825.024199:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300867328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787832825.024277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832825.024419:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300867328 00000100:00100000:1.0:1787832825.024430:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300867328 00000100:00100000:1.0:1787832825.024640:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787832825.024654:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300867328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787832825.025330:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787832825.025336:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787832825 00002000:00010000:1.0:1787832825.025339:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787832825.025341:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787832825 -> 1787832825 00002000:00010000:1.0:1787832825.025344:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1787832825.025490:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832825.025557:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300867328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 906us (1278us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787832825.025568:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787832825.026839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832825.027759:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019648 00000100:00100000:1.0:1787832825.027771:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019648 00000100:00100000:1.0:1787832825.027842:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:1.0:1787832825.027853:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283019648:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1787832825.031904:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c3565b3ad00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787832825.031927:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300867328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787832825.081758:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283019648:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 53891us (54913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832825.081777:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000001:00080000:0.0:1787832825.081891:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787832825.081917:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787832825.089263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832825.089392:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283019904 00000100:00100000:3.0:1787832825.089406:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283019904 00000100:00080000:1.0:1787832825.089490:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832825.089513:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:3.0:1787832825.089525:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10445:x1874678283019904:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832825.089942:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832825.089981:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b71c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70681c expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.090008:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:3.0:1787832825.090014:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832825.090050:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.090226:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.090238:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832825.091172:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9924b0 reply state 00000000ed5a9a6f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832825.091187:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832825.091325:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10445:x1874678283019904:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1799us (2277us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787832825.091353:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1787832825.096372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1787832825.097024:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097041:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097072:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097205:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832825.097212:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097222:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097246:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:0.0:1787832825.097250:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832825.097255:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.097264:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b71db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.098566:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020032 00000100:00100000:1.0:1787832825.098586:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020032 00000100:00100000:1.0:1787832825.098675:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1787832825.098688:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283020032:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787832825.099091:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787832825.099096:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787832825 -> 1787832823 00002000:00010000:1.0:1787832825.099099:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787832822 00002000:00010000:1.0:1787832825.099102:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787832825 -> 1787832823 00002000:00010000:1.0:1787832825.099104:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787832825.099203:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283020032:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 517us (2846us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787832825.099232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:0.0:1787832825.106405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832825.106543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020288 00000100:00100000:1.0:1787832825.106558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020288 00000100:00100000:1.0:1787832825.106644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:1.0:1787832825.106657:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10445:x1874678283020288:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787832825.106804:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.106826:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.106839:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.106893:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.106911:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 13 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.106931:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b383c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300867456:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832825.107071:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832825.110686:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b383c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300867456:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832825.110778:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832825.112960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832825.113300:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020416 00000100:00100000:1.0:1787832825.113331:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020416 00010000:00010000:1.0:1787832825.113389:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.113440:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787832825.113453:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283020416:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832825.113491:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832825.113501:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113518:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113547:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b71a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70680e expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113568:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:1.0:1787832825.113574:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113585:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113594:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.113635:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832825.113766:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2353:x1874678283020416:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 315us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832825.113786:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00010000:00010000:0.0:1787832825.113863:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113874:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113914:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113922:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113939:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113946:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832825.113951:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113961:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113971:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:0.0:1787832825.113974:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787832825.113978:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.113985:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b71e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832825.114029:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:10445:x1874678283020288:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 7375us (7639us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787832825.114039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:0.0:1787832825.119373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832825.119445:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020544 00000100:00100000:1.0:1787832825.119461:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020544 00000100:00100000:1.0:1787832825.119544:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1787832825.119557:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283020544:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787832825.119623:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.119651:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.119662:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787832825.119668:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832825.119674:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.119758:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.119776:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 7 pid: 8408 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.119795:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300867584:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832825.119912:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832825.122947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832825.123099:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b383c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300867584:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832825.123154:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832825.123897:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020672 00000100:00100000:2.0:1787832825.123910:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020672 00010000:00010000:2.0:1787832825.123963:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832825.124076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:2.0:1787832825.124087:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283020672:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832825.124107:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832825.124136:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.124154:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.124191:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a89d5d/0x72bd9178b14b71d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70682a expref: 8 pid: 8408 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.124214:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832825.124220:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832825.124227:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.124239:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.124290:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832825.124377:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283020672:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 292us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832825.124401:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00010000:00010000:1.0:1787832825.125043:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125071:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125105:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125115:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125123:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125132:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832825.125137:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125147:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125165:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.125184:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db1ade5/0x72bd9178b14b71e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.125269:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283020544:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 5712us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832825.125278:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832825.128914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832825.129036:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283020928 00000100:00100000:2.0:1787832825.129048:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283020928 00000100:00100000:2.0:1787832825.129226:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:2.0:1787832825.129238:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:10445:x1874678283020928:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787832825.129347:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129371:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129695:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129743:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129752:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129796:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.129813:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 13 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832825.129855:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300867712:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832825.129970:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832825.134371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832825.134441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283021056 00000100:00100000:0.0:1787832825.134452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283021056 00010000:00010000:0.0:1787832825.134515:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832825.134568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:0.0:1787832825.134598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283021056:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832825.134617:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832825.134625:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.134641:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 14 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.134679:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:0.0:1787832825.134693:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.134728:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.134738:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.134768:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832825.134849:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283021056:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 254us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832825.134858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:2.0:1787832825.136158:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b71b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706815 expref: 13 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832825.136183:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300867712:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832825.136211:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.136222:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.136227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832825.136498:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787832825.136882:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787832825.136933:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787832825.137071:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874678300867840:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787832825.137156:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832825.137191:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832825.137979:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300867840 00000100:00100000:0.0:1787832825.137989:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300867840 00000100:00100000:0.0:1787832825.138070:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832825.138082:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874678300867840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787832825.138206:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874678300867840:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832825.138214:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787832825.138457:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787832825.138464:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c3565b3ad00, transno 4294967303 00000100:00100000:2.0:1787832825.138491:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874678300867840:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787832825.139635:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787832825.139882:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874678300867968:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787832825.139975:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832825.140009:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832825.140215:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300867968 00000100:00100000:0.0:1787832825.140224:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300867968 00000100:00100000:0.0:1787832825.140281:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787832825.140290:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874678300867968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787832825.140609:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1874678300867968:12345-0@lo:1000:mdt00_002.0 Request processed in 318us (632us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787832825.140618:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832825.141216:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874678300867968:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787832825.141271:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141282:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141290:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141298:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74da00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832825.141302:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141310:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141330:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:2.0:1787832825.141334:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832825.141339:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141346:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b71f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141396:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141404:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141426:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141432:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832825.141435:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141441:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141451:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:2.0:1787832825.141454:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832825.141457:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b712c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141501:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141517:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 16 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.141528:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.142141:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 16 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832825.142177:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 16 pid: 10395 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832825.142194:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300868096:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832825.142301:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c355cd7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787832825.145578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832825.145764:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300868096:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832825.145799:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832825.147816:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283021184 00000100:00100000:3.0:1787832825.147833:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283021184 00010000:00010000:3.0:1787832825.147897:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 17 pid: 10395 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832825.147945:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:3.0:1787832825.147957:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:2352:x1874678283021184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832825.147976:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832825.147983:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 17 pid: 10395 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.147998:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 17 pid: 10395 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.148027:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7067f9 expref: 17 pid: 10395 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.148047:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:3.0:1787832825.148063:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.148075:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.148084:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832825.148140:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832825.148224:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:2352:x1874678283021184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 268us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832825.148232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00010000:00010000:1.0:1787832825.148744:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148755:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148770:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148776:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148782:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148787:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832825.148792:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148800:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148822:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:1.0:1787832825.148825:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832825.148830:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148837:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b71fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148853:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148859:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148865:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148871:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832825.148873:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148879:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148887:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3543a9ce00) 00010000:00010000:1.0:1787832825.148889:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787832825.148892:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.148897:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b71f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832825.149531:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10445:x1874678283020928:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 20288us (20624us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787832825.149552:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000020:00080000:1.0:1787832825.149558:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787832825.150081:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832825.150088:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832825.150120:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787832825.150128:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787832825.153139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832825.153281:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283021440 00000100:00100000:0.0:1787832825.153292:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283021440 00000100:00100000:0.0:1787832825.153375:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787832825.153384:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10445:x1874678283021440:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787832825.154235:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787832825.154321:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787832825.154369:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154387:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154399:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154407:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154412:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154416:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832825.154449:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787832825.154591:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10445:x1874678283021440:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1203us (1459us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787832825.154602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000020:00080000:0.0:1787832825.154609:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787832825.154749:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832825.154759:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.154767:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832825.154772:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.154780:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.154797:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c3542b1f700) 00010000:00010000:1.0:1787832825.154800:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787832825.154806:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.154812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832825.154834:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832825.154837:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832825.154838:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832825.548286:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832825.612231:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300868224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832825.612331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832825.613247:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868224 00000100:00100000:1.0:1787832825.613260:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868224 00000100:00100000:1.0:1787832825.613334:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787832825.613362:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300868224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832825.613396:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787832825.613482:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300868224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832825.613490:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787832825.613751:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300868224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832826.125378:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832826.125495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832826.125640:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868352 00000100:00100000:0.0:1787832826.125651:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868352 00000100:00100000:0.0:1787832826.125760:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787832826.125773:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874678300868352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832826.125826:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832826.125879:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874678300868352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.125892:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787832826.125924:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832826.125996:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832826.128143:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300868480:0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.128200:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300868608:0@lo:400:kworker.0 00000100:00100000:3.0:1787832826.128272:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300868864:0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.129870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832826.129927:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832826.129937:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300868736:0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.129963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832826.130388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832826.130496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832826.130546:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832826.130556:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300868992:0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.130871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868608 00000100:00100000:2.0:1787832826.130881:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868608 00000100:00100000:2.0:1787832826.130937:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868736 00000100:00100000:2.0:1787832826.130939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868736 00000100:00100000:2.0:1787832826.130977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787832826.130986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.131065:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300868608:12345-0@lo:400:kworker.0 Request processed in 80us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832826.131085:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787832826.131103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787832826.131108:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300868736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.131313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300868736:12345-0@lo:400:kworker.0 Request processed in 205us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832826.131320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787832826.131342:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868864 00000100:00100000:2.0:1787832826.131345:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868864 00000100:00100000:2.0:1787832826.131373:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787832826.131380:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300868864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.131413:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300868864:12345-0@lo:400:kworker.0 Request processed in 34us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832826.131419:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787832826.131445:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832826.131507:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300868736:0@lo:400:kworker.0 00000100:00100000:2.0:1787832826.131521:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300868608:0@lo:400:kworker.0 00000100:00100000:3.0:1787832826.132544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832826.132627:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300868864:0@lo:400:kworker.0 00000100:00100000:3.0:1787832826.134466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868992 00000100:00100000:3.0:1787832826.134484:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868992 00000100:00100000:3.0:1787832826.134576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787832826.134588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300868992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832826.134735:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300868992:12345-0@lo:400:kworker.0 Request processed in 115us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832826.134746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787832826.134802:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300868992:0@lo:400:kworker.0 00000100:00080000:2.0:1787832826.134918:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832826.135256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300868480 00000100:00100000:0.0:1787832826.135263:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300868480 00000100:00100000:0.0:1787832826.135309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787832826.135318:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300868480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832826.135422:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300868480:12345-0@lo:400:kworker.0 Request processed in 105us (5039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.135429:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787832826.139290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300868480:0@lo:400:kworker.0 00000040:00080000:2.0:1787832826.491695:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832826.491730:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832826.491767:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787832826.491773:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787832826.572870:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832826.613164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832826.613251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283021696 00000100:00100000:2.0:1787832826.613264:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283021696 00000100:00100000:2.0:1787832826.613349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:2.0:1787832826.613361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:10462:x1874678283021696:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832826.613409:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832826.613440:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b720c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706831 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.613976:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7213 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.613998:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.614012:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7213 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832826.614026:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787832826.614231:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b720c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706831 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.614249:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7213 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706831 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.614259:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832826.614262:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787832826.614266:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74da00, rc 0) 00000100:00100000:2.0:1787832826.614727:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10462:x1874678283021696:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1366us (1576us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787832826.614737:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:2.0:1787832826.629727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.629882:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283021824 00000100:00100000:0.0:1787832826.629895:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283021824 00000100:00100000:0.0:1787832826.629968:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:0.0:1787832826.629978:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10462:x1874678283021824:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787832826.630076:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630096:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630110:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630154:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630162:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630170:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630815:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630826:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630846:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832826.630900:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630914:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630921:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630929:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630937:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.630941:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630949:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630963:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832826.630966:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.630971:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630978:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.630993:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631005:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631012:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631018:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.631021:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631027:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631034:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3542b1fb00) 00010000:00010000:0.0:1787832826.631037:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.631039:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631045:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631060:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631067:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631073:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631078:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.631084:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631091:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631099:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1f100) 00010000:00010000:0.0:1787832826.631101:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.631103:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.631109:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b722f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832826.631261:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10462:x1874678283021824:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1281us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.631271:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:2.0:1787832826.727325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.729365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283022080 00000100:00100000:0.0:1787832826.729382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283022080 00000100:00100000:0.0:1787832826.729466:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787832826.729479:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10465:x1874678283022080:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832826.729506:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832826.730879:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706838 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731000:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731018:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731048:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731065:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731080:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731479:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731490:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731497:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832826.731509:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787832826.731629:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731637:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731804:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731812:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.731823:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731833:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832826.731851:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.731857:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731864:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b723d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731880:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731886:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731892:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731898:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.731901:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731907:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731913:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3542b1f100) 00010000:00010000:0.0:1787832826.731915:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.731923:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731929:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731982:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.731996:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.732003:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:0.0:1787832826.732006:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832826.732009:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832826.732094:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10465:x1874678283022080:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2617us (4782us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787832826.732104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787832826.757691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.758163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283022208 00000100:00100000:1.0:1787832826.758178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283022208 00000100:00100000:1.0:1787832826.758280:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:1.0:1787832826.758293:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10465:x1874678283022208:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1787832826.758626:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758651:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758667:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758778:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758785:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758808:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832826.758814:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758822:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758839:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:1.0:1787832826.758842:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832826.758848:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.758853:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832826.758948:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10465:x1874678283022208:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 657us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832826.758957:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:2.0:1787832826.770577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832826.770817:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283022464 00000100:00100000:3.0:1787832826.770830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283022464 00000100:00100000:3.0:1787832826.770939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1787832826.770952:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10465:x1874678283022464:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832826.771307:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:10465:x1874678283022464:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 357us (745us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787832826.771324:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787832826.816413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.816545:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283022720 00000100:00100000:1.0:1787832826.816559:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283022720 00000100:00100000:1.0:1787832826.816637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:1.0:1787832826.816657:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:9985:x1874678283022720:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832826.816690:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832826.816768:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7260 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70683f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.816903:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.816942:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.816952:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.817006:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.817022:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 23 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832826.817038:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b3b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300869120:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832826.817149:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832826.820653:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b3b840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300869120:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832826.820925:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832826.821242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.821329:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283022848 00000100:00100000:0.0:1787832826.821337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283022848 00010000:00010000:0.0:1787832826.821388:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 24 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832826.821433:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:0.0:1787832826.821456:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:2352:x1874678283022848:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832826.821477:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832826.821484:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 24 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821529:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 24 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821557:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b724b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706838 expref: 24 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821578:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:0.0:1787832826.821583:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821594:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821602:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.821633:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832826.822435:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:2352:x1874678283022848:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 987us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.822459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00010000:00010000:2.0:1787832826.822936:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.822948:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832826.822976:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787832826.823244:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b7260 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.823268:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.823278:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:2.0:1787832826.823281:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787832826.823284:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41e00, rc 0) 00000100:00100000:2.0:1787832826.823348:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:9985:x1874678283022720:12345-192.168.201.34@tcp:101:bash.0 Request processed in 6694us (6952us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787832826.823358:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:2.0:1787832826.831804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.831901:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023104 00000100:00100000:0.0:1787832826.831914:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023104 00000100:00100000:0.0:1787832826.832003:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:0.0:1787832826.832016:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:9985:x1874678283023104:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1787832826.832378:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.832401:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.832434:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832826.832517:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787832826.832549:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e9ec5a7 reply state 00000000ba840888 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832826.832560:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787832826.832614:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787832826.832802:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:9985:x1874678283023104:12345-192.168.201.34@tcp:36:bash.0 Request processed in 788us (1012us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787832826.832811:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000020:00080000:0.0:1787832826.832817:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787832826.836529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:2.0:1787832826.836735:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836750:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836759:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836786:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832826.836793:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836802:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836824:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:2.0:1787832826.836827:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832826.836833:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832826.836839:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832826.837526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023232 00000100:00100000:3.0:1787832826.837540:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023232 00000100:00100000:3.0:1787832826.837617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1787832826.837629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:9985:x1874678283023232:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832826.837918:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832826.837946:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b727c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706846 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832826.838029:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b727c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706846 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832826.838045:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b727c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706846 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832826.838067:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:3.0:1787832826.838070:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832826.838074:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832826.838160:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:9985:x1874678283023232:12345-192.168.201.34@tcp:101:bash.0 Request processed in 534us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832826.838170:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:2.0:1787832826.842093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.842219:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023360 00000100:00100000:0.0:1787832826.842234:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023360 00000100:00100000:0.0:1787832826.842359:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1787832826.842372:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:9985:x1874678283023360:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832826.842398:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832826.842429:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70684d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787832826.842476:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9029f7, atime: 0x6a9029f6, ctime: 0x6a9029f7, blocks: 0xb 00010000:00010000:0.0:1787832826.842503:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1787832826.843180:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832826.843196:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.843248:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.843265:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832826.843363:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:9985:x1874678283023360:12345-192.168.201.34@tcp:101:bash.0 Request processed in 994us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.843373:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00080000:2.0:1787832826.846273:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832826.848132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.848290:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023488 00000100:00100000:1.0:1787832826.848302:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023488 00002000:00010000:1.0:1787832826.848361:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787832826.848367:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565f6e940 with x1874678283023488 ext(0->18446744073709551615) 00002000:00010000:1.0:1787832826.848384:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565f6e940. 00000100:00100000:1.0:1787832826.848469:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832826.848481:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283023488:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:1.0:1787832826.848927:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787832826.848931:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787832823 -> 1787832827 00002000:00010000:1.0:1787832826.848934:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787832822 -> 1787832822 00002000:00010000:1.0:1787832826.848936:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787832823 -> 1787832827 00002000:00010000:1.0:1787832826.848939:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787832826.849071:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283023488:12345-192.168.201.34@tcp:10:bash.0 Request processed in 592us (953us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787832826.849082:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00010000:1.0:1787832826.849087:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787832826.849089:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565f6e940 with x1874678283023488 ext(0->18446744073709551615) 00002000:00010000:1.0:1787832826.849097:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565f6e940. 00000100:00100000:1.0:1787832826.877490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.877545:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832826.877657:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023616 00000100:00100000:3.0:1787832826.877691:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023616 00002000:00100000:3.0:1787832826.877803:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8c3565b38b40 x1874678283023616/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:387/0 lens 496/0 e 0 to 0 dl 1787832837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832826.877817:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565b38b40 with x1874678283023616 ext(0->7) 00002000:00010000:3.0:1787832826.877824:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565b38b40 00000100:00100000:3.0:1787832826.877863:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787832826.877875:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283023616:12345-192.168.201.34@tcp:4:bash.0 00000100:00100000:3.0:1787832826.878549:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283023616:12345-192.168.201.34@tcp:4:bash.0 Request processed in 670us (1067us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787832826.878561:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:3.0:1787832826.878570:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff8c3565b38b40 x1874678283023616/t4294967307(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:387/0 lens 496/448 e 0 to 0 dl 1787832837 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832826.878581:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565b38b40 with x1874678283023616 ext(0->7) 00002000:00010000:3.0:1787832826.878585:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565b38b40 00000100:00100000:2.0:1787832826.879652:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023744 00000100:00100000:2.0:1787832826.879664:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023744 00000100:00100000:2.0:1787832826.879881:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1787832826.879894:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283023744:12345-192.168.201.34@tcp:16:kworker.0 00000100:00100000:2.0:1787832826.939945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832826.939988:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283023872 00000100:00100000:0.0:1787832826.940002:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283023872 00000100:00100000:0.0:1787832826.940113:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:0.0:1787832826.940126:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10479:x1874678283023872:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787832826.940226:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940248:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940264:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940281:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940289:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940296:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940751:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940764:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940773:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832826.940831:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940845:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940853:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940861:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940869:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.940874:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940882:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940898:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832826.940903:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.940908:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940923:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b728a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940942:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940949:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940955:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940961:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.940964:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940972:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940982:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3542b1f000) 00010000:00010000:0.0:1787832826.940985:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.940989:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.940995:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941014:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941020:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941034:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941041:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832826.941044:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941051:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941061:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:0.0:1787832826.941063:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832826.941066:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832826.941073:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832826.941185:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10479:x1874678283023872:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1058us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832826.941197:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000001:00080000:3.0:1787832826.963295:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787832826.963334:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1787832826.963354:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:2.0:1787832826.963572:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283023744:12345-192.168.201.34@tcp:16:kworker.0 Request processed in 83673us (86018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832826.963587:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:2.0:1787832826.988908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.989350:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283024128 00000100:00100000:1.0:1787832826.989364:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283024128 00000100:00100000:1.0:1787832826.989463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:1.0:1787832826.989475:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:10482:x1874678283024128:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832826.989505:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832826.989534:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b729f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706854 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989635:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989654:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989671:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989689:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989698:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.989757:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990229:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b72b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990240:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990248:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b72b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832826.990261:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787832826.990381:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990389:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990396:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990402:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832826.990407:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990415:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990430:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832826.990434:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832826.990457:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990464:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990481:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990488:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990493:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990499:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832826.990502:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990508:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990516:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543c5a800) 00010000:00010000:1.0:1787832826.990519:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832826.990522:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990527:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990581:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b729f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706854 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990610:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b72b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706854 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.990618:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:1.0:1787832826.990621:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787832826.990624:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40a00, rc 0) 00000100:00100000:1.0:1787832826.990762:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10482:x1874678283024128:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1288us (1868us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787832826.990772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1787832826.994522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.995274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283024256 00000100:00100000:1.0:1787832826.995288:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283024256 00000100:00100000:1.0:1787832826.995406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1787832826.995420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10482:x1874678283024256:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1787832826.995534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.995557:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.995569:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.995621:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832826.995637:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 29 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832826.995673:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b38780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300869248:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832826.995832:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832826.999208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832826.999765:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b38780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300869248:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832826.999799:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.000379:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283024512 00000100:00100000:2.0:1787832827.000391:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283024512 00000100:00100000:2.0:1787832827.000480:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1787832827.000492:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:5595:x1874678283024512:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787832827.001437:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:5595:x1874678283024512:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 939us (2236us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787832827.001459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:2.0:1787832827.005165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.005242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283024640 00000100:00100000:3.0:1787832827.005255:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283024640 00010000:00010000:3.0:1787832827.005332:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 31 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.005386:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:3.0:1787832827.005397:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b26580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:2352:x1874678283024640:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832827.005418:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832827.005426:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 31 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005472:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 31 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005512:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b7267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70683f expref: 31 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005536:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:3.0:1787832827.005542:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005553:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005563:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.005602:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832827.005812:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005822:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005860:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005868:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005875:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005881:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832827.005886:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005893:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005903:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:1.0:1787832827.005916:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832827.005920:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.005927:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.006027:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10482:x1874678283024256:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 10610us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832827.006037:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00080000:2.0:1787832827.009668:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832827.010386:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b26580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:2352:x1874678283024640:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4978us (5222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832827.010404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832827.010582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.013183:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283024896 00000100:00100000:0.0:1787832827.013206:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283024896 00000100:00100000:0.0:1787832827.013351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1787832827.013364:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:10482:x1874678283024896:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787832827.013769:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10482:x1874678283024896:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 407us (3186us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787832827.013800:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:2.0:1787832827.090382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.090476:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283025152 00000100:00100000:1.0:1787832827.090489:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283025152 00000100:00100000:1.0:1787832827.090620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:1.0:1787832827.090637:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:10493:x1874678283025152:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:1.0:1787832827.090682:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832827.090732:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70685b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090833:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090850:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090864:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090881:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090887:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.090915:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091313:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b72de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091324:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b72de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091332:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b72de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832827.091344:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787832827.091480:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091489:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091496:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091502:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832827.091506:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091515:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091529:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832827.091532:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832827.091545:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091553:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b72d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091571:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091578:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091585:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091590:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832827.091593:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091599:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091606:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543c5a800) 00010000:00010000:1.0:1787832827.091609:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832827.091611:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091617:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b72d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091681:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b72c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70685b expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091783:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b72de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70685b expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.091792:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:1.0:1787832827.091795:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832827.091797:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41e00, rc 0) 00000100:00100000:1.0:1787832827.091884:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:10493:x1874678283025152:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1255us (1514us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787832827.091893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:1.0:1787832827.096277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.096548:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283025408 00000100:00100000:3.0:1787832827.096562:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283025408 00000100:00100000:3.0:1787832827.096825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787832827.096842:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:10493:x1874678283025408:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:3.0:1787832827.097173:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10493:x1874678283025408:12345-192.168.201.34@tcp:35:cat.0 Request processed in 334us (911us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787832827.105146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:0.0:1787832827.123208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832827.123333:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283025664 00000100:00100000:2.0:1787832827.123345:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283025664 00000100:00100000:2.0:1787832827.123523:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:2.0:1787832827.123544:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10494:x1874678283025664:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1787832827.123628:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787832827.123677:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b72de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70685b expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123754:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b72b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706854 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123772:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b727c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706846 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123783:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3542b1fb00) 00010000:00010000:2.0:1787832827.123795:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832827.123844:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123861:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123874:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123905:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123913:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.123920:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.124312:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.124322:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.124330:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787832827.125093:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787832827.125106:0:10395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350153403014ns, next at 351153400074ns, rc = 0 00010000:00010000:2.0:1787832827.125192:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125206:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125227:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125237:0:10395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125245:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125252:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125289:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832827.125319:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125326:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125333:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125339:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832827.125344:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125354:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125367:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3547ea9800) 00010000:00010000:2.0:1787832827.125370:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787832827.125382:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125389:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b72fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125417:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125424:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125430:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125435:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832827.125449:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125455:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125463:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832827.125465:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832827.125468:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.125473:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b72ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832827.125484:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021df4601 reply state 00000000dd058e02 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.125503:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832827.125624:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:10494:x1874678283025664:12345-192.168.201.34@tcp:36:rm.0 Request processed in 2086us (2427us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787832827.125635:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00010000:00010000:3.0:1787832827.125766:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832827.125775:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.125782:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832827.125785:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.125791:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.125801:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3547ea9800) 00010000:00010000:3.0:1787832827.125803:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787832827.125807:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.125813:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7301 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.125830:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832827.125832:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832827.125833:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832827.132320:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132347:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132355:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132362:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.132368:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132378:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132402:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3547ea9900) 00010000:00010000:0.0:1787832827.132406:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832827.132412:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.132419:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b72f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.222244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.225829:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283025920 00000100:00100000:3.0:1787832827.225852:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283025920 00000100:00100000:3.0:1787832827.225934:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:3.0:1787832827.226769:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:10500:x1874678283025920:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832827.226809:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832827.226839:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7308 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706862 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227144:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227181:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227201:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227225:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227233:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.227241:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832827.229156:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787832827.229761:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229783:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229795:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229845:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229853:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229862:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229885:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832827.229891:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229900:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229916:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832827.229920:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832827.229926:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.229933:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b730f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832827.229961:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5ae6875 reply state 00000000932e71c3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.229972:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787832827.230022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7308 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.230039:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.230047:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832827.230050:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832827.230053:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832827.230168:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:10500:x1874678283025920:12345-192.168.201.34@tcp:101:bash.0 Request processed in 3470us (7943us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787832827.230185:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00010000:00010000:3.0:1787832827.232569:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232597:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232607:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232613:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832827.232620:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232630:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232916:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9c700) 00010000:00010000:3.0:1787832827.232921:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832827.232928:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.232935:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.237518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.238111:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026048 00000100:00100000:1.0:1787832827.238126:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026048 00000100:00100000:1.0:1787832827.238214:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:1.0:1787832827.238227:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283026048:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832827.238252:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832827.238280:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706869 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787832827.239033:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832827.239070:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1787832827.239076:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832827.239091:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 6 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.239145:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 6 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.239162:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41400, rc 0) 00000100:00100000:1.0:1787832827.239252:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283026048:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1027us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832827.239261:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00080000:1.0:1787832827.239301:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832827.245952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.246257:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026176 00000100:00100000:0.0:1787832827.246273:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026176 00000100:00100000:0.0:1787832827.246369:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:0.0:1787832827.246398:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:10500:x1874678283026176:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832827.246426:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832827.246458:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706870 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.246504:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.246516:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832827.246521:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832827.246526:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.246829:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.246848:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.246866:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874678300869376:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832827.247069:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354639a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787832827.254120:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874678300869376:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832827.254174:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.254203:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00100000:2.0:1787832827.254288:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:10500:x1874678283026176:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7891us (8364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832827.254300:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1787832827.257076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000001:00080000:1.0:1787832827.257471:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:1.0:1787832827.257491:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787832827.258631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026304 00000100:00100000:2.0:1787832827.258647:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026304 00010000:00010000:2.0:1787832827.258919:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.259153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787832827.259168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283026304:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832827.259207:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832827.259240:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.259259:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.259289:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e489f3e4/0x72bd9178b14b732b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706869 expref: 7 pid: 8408 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.259310:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832827.259316:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832827.259337:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.259348:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.259403:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.259421:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1874678300869504:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787832827.259570:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3573924900 going to sleep for 11 seconds 00000100:00100000:2.0:1787832827.262853:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.263353:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb761c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1874678300869504:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787832827.263388:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832827.263496:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283026304:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4331us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832827.263511:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1787832827.263689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026560 00000100:00100000:0.0:1787832827.263698:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026560 00000100:00100000:0.0:1787832827.263863:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787832827.263874:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:10500:x1874678283026560:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:0.0:1787832827.264398:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:10500:x1874678283026560:12345-192.168.201.34@tcp:35:bash.0 Request processed in 524us (1559us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787832827.264418:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787832827.483109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.483348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026688 00000100:00100000:1.0:1787832827.483363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026688 00000100:00100000:2.0:1787832827.484335:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787832827.484359:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:10516:x1874678283026688:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832827.484394:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832827.484423:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706877 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.484544:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.484585:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.484601:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832827.485057:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787832827.485063:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832827.485099:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.485137:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706877 expref: 36 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.485160:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706877 expref: 35 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.485169:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:2.0:1787832827.485173:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832827.485178:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74dc00, rc 0) 00000100:00100000:2.0:1787832827.485280:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:10516:x1874678283026688:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 931us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832827.485290:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:2.0:1787832827.500507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.500900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283026944 00000100:00100000:3.0:1787832827.500913:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283026944 00000100:00100000:3.0:1787832827.501014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1787832827.501025:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:10516:x1874678283026944:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832827.501056:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832827.501083:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7347 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70687e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.501223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b734e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.501241:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b734e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.501256:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b734e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832827.501269:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787832827.501754:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7347 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70687e expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.501779:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b734e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70687e expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.501789:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832827.501792:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832827.501814:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832827.501974:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:10516:x1874678283026944:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 949us (1483us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787832827.501984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1787832827.513685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.514113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027072 00000100:00100000:0.0:1787832827.514127:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027072 00000100:00100000:0.0:1787832827.514213:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787832827.514226:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:2352:x1874678283027072:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832827.514246:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832827.514280:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b734e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70687e expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.514302:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:0.0:1787832827.514326:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832827.514405:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:2352:x1874678283027072:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 182us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.514414:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787832827.517550:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832827.517999:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027328 00000100:00100000:2.0:1787832827.518012:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027328 00000100:00100000:2.0:1787832827.518119:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1787832827.518132:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:10516:x1874678283027328:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832827.518187:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832827.518214:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b735c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706885 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.518538:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.518557:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.518571:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832827.518586:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787832827.518889:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b735c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706885 expref: 39 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.518912:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706885 expref: 38 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.518923:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:2.0:1787832827.518927:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787832827.518931:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c600, rc 0) 00000100:00100000:2.0:1787832827.519158:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:10516:x1874678283027328:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1028us (1624us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787832827.519167:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:2.0:1787832827.527863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.528063:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027456 00000100:00100000:1.0:1787832827.528077:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027456 00000100:00100000:1.0:1787832827.528157:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:1.0:1787832827.528171:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283027456:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:1.0:1787832827.528235:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.528260:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.528271:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832827.528276:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832827.528281:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.528351:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.528370:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 6 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.528389:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b3a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300869632:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832827.528531:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565b57b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832827.537739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.537873:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b3a940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300869632:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832827.537914:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.542415:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027584 00000100:00100000:1.0:1787832827.542455:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027584 00002000:00100000:1.0:1787832827.542551:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c357bb74f00 x1874678283027584/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:388/0 lens 504/0 e 0 to 0 dl 1787832838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832827.542565:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357bb74f00 with x1874678283027584 ext(0->8) 00010000:00010000:1.0:1787832827.542577:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 7 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.542597:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 7 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787832827.542607:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c357bb74f00 00000100:00100000:1.0:1787832827.542645:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832827.542657:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283027584:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:1.0:1787832827.543373:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283027584:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 714us (5647us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787832827.543394:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00002000:00100000:1.0:1787832827.543404:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c357bb74f00 x1874678283027584/t4294967302(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:388/0 lens 504/448 e 0 to 0 dl 1787832838 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832827.543414:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357bb74f00 with x1874678283027584 ext(0->8) 00010000:00010000:1.0:1787832827.543421:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.543450:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787832827.543458:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c357bb74f00 00000100:00100000:2.0:1787832827.556069:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.557942:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027712 00000100:00100000:1.0:1787832827.557965:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027712 00010000:00010000:1.0:1787832827.558031:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.558093:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1787832827.558104:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b27840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283027712:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832827.558127:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787832827.558154:0:8455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787832827.558158:0:8455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787832827 00002000:00010000:1.0:1787832827.558160:0:8455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787832828 00002000:00010000:1.0:1787832827.558162:0:8455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787832827 00010000:00010000:1.0:1787832827.558170:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.558213:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.558247:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a275c9bd/0x72bd9178b14b7332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706870 expref: 9 pid: 6697 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.558272:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832827.558277:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832827.558284:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.558296:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.558347:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832827.558446:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b27840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283027712:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 343us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832827.558456:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00010000:00010000:0.0:1787832827.559355:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559371:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559409:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559419:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559453:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559460:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832827.559465:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559475:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559493:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.559512:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a89d5d/0x72bd9178b14b7371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.559671:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283027456:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 31499us (31822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.559682:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:2.0:1787832827.568529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.568659:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283027968 00000100:00100000:0.0:1787832827.568675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283027968 00000100:00100000:0.0:1787832827.568784:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:0.0:1787832827.568798:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:10516:x1874678283027968:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:0.0:1787832827.568906:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706885 expref: 38 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832827.569295:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787832827.569347:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787832827.569791:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787832827.569853:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.569874:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.569885:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.569929:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.569949:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 42 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.569965:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300869760:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832827.570094:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35465243c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832827.574508:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300869760:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832827.574550:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.575555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.576761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028096 00000100:00100000:0.0:1787832827.576776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028096 00010000:00010000:0.0:1787832827.576843:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 43 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.576888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:0.0:1787832827.576898:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:2353:x1874678283028096:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832827.576937:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832827.576945:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 43 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.576960:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 43 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.576985:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b731d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706862 expref: 43 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.577006:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:0.0:1787832827.577011:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.577022:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.577031:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.577067:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832827.577146:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+42:2353:x1874678283028096:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 248us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.577153:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00010000:00010000:2.0:1787832827.577348:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.577358:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832827.577546:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787832827.577885:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787832827.578023:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300869888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787832827.579045:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832827.579126:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300869888 00000100:00100000:2.0:1787832827.579136:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300869888 00000100:00100000:2.0:1787832827.579194:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832827.579205:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300869888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787832827.579296:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300869888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832827.579305:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832827.580748:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787832827.580797:0:5848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787832827.580805:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1787832827.580830:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c356579de00, transno 4294967301 00000100:00100000:2.0:1787832827.580863:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300869888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787832827.586931:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787832827.588690:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300870016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787832827.588973:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832827.589075:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3558afba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832827.592953:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300870016 00000100:00100000:0.0:1787832827.592977:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300870016 00000100:00100000:0.0:1787832827.593105:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787832827.593120:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300870016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787832827.593521:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874678300870016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 404us (4548us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787832827.593550:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832827.593674:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300870016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787832827.593802:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787832827.593863:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593876:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593884:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593892:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832827.593898:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593906:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593926:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832827.593935:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787832827.593943:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832827.593950:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7378 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832827.594194:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787832827.594311:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787832827.594324:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350622620307ns, next at 351622618236ns, rc = 0 00000001:00080000:3.0:1787832827.594331:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787832827.594365:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832827.594369:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787832827.594377:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7363 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706885 expref: 46 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.594529:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:10516:x1874678283027968:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 25734us (26018us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787832827.594539:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000020:00080000:3.0:1787832827.594544:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787832827.597813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.597914:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028224 00000100:00100000:1.0:1787832827.597927:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028224 00000100:00100000:1.0:1787832827.598019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:1.0:1787832827.598031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:10516:x1874678283028224:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832827.598064:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832827.598098:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b737f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70688c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.598218:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b737f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70688c expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.598238:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b737f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70688c expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.598262:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832827.598266:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832827.598270:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40c00, rc 0) 00000100:00100000:1.0:1787832827.598346:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+46:10516:x1874678283028224:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 317us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832827.598354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00010000:00010000:3.0:1787832827.600021:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832827.602002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832827.602110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028480 00000100:00100000:2.0:1787832827.602124:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028480 00000100:00100000:2.0:1787832827.602198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1787832827.602210:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+46:10516:x1874678283028480:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832827.602572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:10516:x1874678283028480:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 363us (583us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787832827.602581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:2.0:1787832827.703154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.703639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028608 00000100:00100000:0.0:1787832827.703655:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028608 00000100:00100000:0.0:1787832827.703778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1787832827.703793:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:10526:x1874678283028608:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787832827.703902:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.703923:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.703937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.703957:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.703965:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.703972:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704118:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704136:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832827.704216:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704232:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704251:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704260:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704267:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.704272:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704281:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704298:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832827.704301:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832827.704415:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704425:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704451:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704457:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704471:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704477:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.704480:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704487:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704496:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3542b1f900) 00010000:00010000:0.0:1787832827.704499:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832827.704502:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704508:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b738d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704524:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704531:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704537:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704542:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.704545:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704562:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704570:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832827.704572:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832827.704575:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.704580:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.704892:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:10526:x1874678283028608:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1097us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.704904:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1787832827.770214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.770482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028864 00000100:00100000:1.0:1787832827.770506:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028864 00000100:00100000:1.0:1787832827.770594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:1.0:1787832827.770607:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:10529:x1874678283028864:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832827.770638:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832827.770673:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b739b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706893 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770860:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770880:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770918:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770937:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770945:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.770952:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771155:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771166:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771173:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832827.771187:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787832827.771335:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771344:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771351:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771357:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832827.771371:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771379:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832827.771398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832827.771404:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771410:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771437:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771444:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771451:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771456:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832827.771460:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771466:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771473:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543c5ad00) 00010000:00010000:1.0:1787832827.771475:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832827.771486:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771492:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771548:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b739b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771565:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.771572:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832827.771575:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832827.771578:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832827.771678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:10529:x1874678283028864:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1073us (1481us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787832827.771688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:1.0:1787832827.779848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.779973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283028992 00000100:00100000:0.0:1787832827.779986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283028992 00000100:00100000:0.0:1787832827.780078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:0.0:1787832827.780090:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:10529:x1874678283028992:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787832827.780192:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780215:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780229:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780266:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780294:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780312:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780319:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.780325:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780334:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780351:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832827.780354:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832827.780361:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.780367:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b73be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.780480:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:10529:x1874678283028992:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 392us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.780491:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 103 00000100:00100000:2.0:1787832827.791069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832827.791601:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283029248 00000100:00100000:3.0:1787832827.791615:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283029248 00000100:00100000:3.0:1787832827.791845:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1787832827.791860:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:10529:x1874678283029248:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832827.792224:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:10529:x1874678283029248:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 367us (1174us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787832827.792440:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:3.0:1787832827.883972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.886794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283029504 00000100:00100000:1.0:1787832827.886820:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283029504 00000100:00100000:1.0:1787832827.886940:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:1.0:1787832827.886954:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:10539:x1874678283029504:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832827.886991:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832827.886995:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787832827.887035:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b7340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706877 expref: 50 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887064:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832827.887088:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832827.887110:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70689a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887244:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887262:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887273:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887318:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.887335:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 50 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.887351:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b39e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300870144:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832827.887507:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565b57b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832827.892968:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b39e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300870144:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832827.893006:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.893643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832827.895296:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283029632 00000100:00100000:1.0:1787832827.895322:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283029632 00010000:00010000:1.0:1787832827.895390:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 51 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832827.895449:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1787832827.895461:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:2352:x1874678283029632:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832827.895483:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832827.895525:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 51 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.895542:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 51 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.895573:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b73b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706893 expref: 51 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.895596:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832827.895603:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.895614:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.895638:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832827.897409:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832827.897591:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:2352:x1874678283029632:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 2122us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832827.897609:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00010000:00010000:0.0:1787832827.911940:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.911962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832827.911993:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787832827.912250:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b73c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.912279:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.912289:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832827.912292:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787832827.912297:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41400, rc 0) 00000100:00100000:0.0:1787832827.912649:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:10539:x1874678283029504:12345-192.168.201.34@tcp:101:bash.0 Request processed in 25695us (28691us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787832827.912661:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:3.0:1787832827.926409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832827.926943:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283029888 00000100:00100000:2.0:1787832827.926958:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283029888 00000100:00100000:2.0:1787832827.927045:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 105 00000100:00100000:2.0:1787832827.928335:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:10539:x1874678283029888:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1787832827.930400:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.930443:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.930459:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832827.930605:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787832827.930672:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcfe416 reply state 00000000487b4f0b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.930724:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832827.930883:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:10539:x1874678283029888:12345-192.168.201.34@tcp:36:bash.0 Request processed in 3823us (4486us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787832827.930893:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 105 00000020:00080000:2.0:1787832827.930900:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787832827.935087:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935110:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935119:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935126:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832827.935132:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935142:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935165:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832827.935169:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832827.935196:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.935204:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b73da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832827.937104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.937338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030016 00000100:00100000:0.0:1787832827.937352:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030016 00000100:00100000:0.0:1787832827.937434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:0.0:1787832827.937447:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:10539:x1874678283030016:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832827.937481:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832827.937519:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b73e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.938147:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.938169:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.938181:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.938227:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.938244:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 53 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832827.938259:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300870272:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832827.938446:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546524a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832827.948284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832827.948412:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300870272:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832827.948468:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.948868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030144 00000100:00100000:2.0:1787832827.948877:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030144 00010000:00010000:2.0:1787832827.948926:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 54 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832827.948972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787832827.948983:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:2352:x1874678283030144:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832827.949005:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832827.949014:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 54 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949027:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 54 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949057:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b73cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70689a expref: 54 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949075:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:2.0:1787832827.949081:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949092:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949120:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832827.949285:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832827.949359:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:2352:x1874678283030144:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 377us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832827.949368:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00010000:00010000:0.0:1787832827.952469:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.952506:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832827.952665:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787832827.952671:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832827.952699:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.953227:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b73e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.953258:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832827.953269:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832827.953273:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832827.953278:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832827.953404:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:10539:x1874678283030016:12345-192.168.201.34@tcp:101:bash.0 Request processed in 15957us (16319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832827.953415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 106 00000100:00100000:0.0:1787832827.958816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832827.959020:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030400 00000100:00100000:2.0:1787832827.959034:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030400 00000100:00100000:2.0:1787832827.959104:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787832827.959116:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:10539:x1874678283030400:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:2.0:1787832827.959496:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:10539:x1874678283030400:12345-192.168.201.34@tcp:35:bash.0 Request processed in 380us (694us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787832827.959507:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787832828.164248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832828.164575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030528 00000100:00100000:0.0:1787832828.164589:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030528 00000100:00100000:0.0:1787832828.164675:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:0.0:1787832828.164688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:10545:x1874678283030528:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832828.164772:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832828.164800:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b73ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068a8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.164899:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.164918:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.165149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832828.165230:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787832828.165235:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832828.165266:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.165415:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b73ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a8 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.165451:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a8 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.165461:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832828.165464:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832828.165488:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:0.0:1787832828.165585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283030528:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 900us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832828.165595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 107 00000100:00100000:0.0:1787832828.178285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832828.179754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030656 00000100:00100000:3.0:1787832828.179772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030656 00000100:00100000:3.0:1787832828.179855:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:3.0:1787832828.179865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283030656:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832828.179895:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832828.180188:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b73fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068af expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180454:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180476:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180490:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180509:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.180533:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182463:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182502:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832828.182558:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787832828.182564:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832828.182589:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182604:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182615:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182621:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182628:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182635:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832828.182640:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182668:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182684:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832828.182688:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832828.182693:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.182731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183324:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183330:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183342:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832828.183345:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183352:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183362:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832828.183366:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832828.183369:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183390:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b740b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183454:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b73fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183472:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.183480:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:3.0:1787832828.183483:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832828.183486:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832828.183590:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10545:x1874678283030656:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 3725us (5321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832828.183601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 108 00000100:00100000:1.0:1787832828.195387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832828.195496:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283030912 00000100:00100000:0.0:1787832828.195509:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283030912 00000100:00100000:0.0:1787832828.195589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:0.0:1787832828.195603:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10545:x1874678283030912:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832828.195642:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832828.195670:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068b6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195858:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195879:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195889:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195899:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195955:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.195974:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832828.196007:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300870400:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832828.196125:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.196132:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832828.196139:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300870528:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832828.196159:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546524a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832828.196634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832828.197252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031040 00000100:00100000:1.0:1787832828.197262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031040 00010000:00010000:1.0:1787832828.197316:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 57 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832828.197377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1787832828.197387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:2353:x1874678283031040:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832828.197402:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832828.197410:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 57 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.197435:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 57 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.197461:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832828.197466:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.197474:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.197481:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832828.197528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:2353:x1874678283031040:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 143us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832828.197534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00010000:00010000:0.0:1787832828.225815:0:5844:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.34@tcp) returned -22 from blocking AST (req@000000003c559fd4 x1874678300870400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.225846:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068af expref: 56 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832828.225867:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c83c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300870400:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832828.225884:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300870528:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832828.225919:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832828.225926:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.225937:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.225982:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832828.235173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832828.236095:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031168 00000100:00100000:2.0:1787832828.236111:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031168 00010000:00010000:2.0:1787832828.236171:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832828.236258:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1787832828.236271:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:2353:x1874678283031168:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832828.236294:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832828.236316:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236355:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236384:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b73e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a1 expref: 56 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236402:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:2.0:1787832828.236408:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236428:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236437:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.236519:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832828.236603:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:2353:x1874678283031168:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 335us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832828.236611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00010000:00010000:1.0:1787832828.237664:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.237678:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832828.237843:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787832828.238126:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.238150:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832828.238159:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832828.238162:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832828.238166:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00100000:1.0:1787832828.238322:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10545:x1874678283030912:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 42721us (42949us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787832828.238332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 109 00000100:00100000:1.0:1787832828.255851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832828.256224:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031424 00000100:00100000:3.0:1787832828.256245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031424 00000100:00100000:3.0:1787832828.256339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832828.256353:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10545:x1874678283031424:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:3.0:1787832828.256375:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832828.256595:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b737f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70688c expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832828.256629:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:3.0:1787832828.256636:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832828.258368:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283031424:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 2006us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832828.258384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787832828.266517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832828.266958:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031552 00000100:00100000:0.0:1787832828.266971:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031552 00000100:00100000:0.0:1787832828.267189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:0.0:1787832828.267202:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283031552:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:0.0:1787832828.267380:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.267404:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832828.267428:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832828.269147:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787832828.269400:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283031552:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 2189us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832828.269425:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 110 00000100:00100000:1.0:1787832828.287136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832828.287635:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031680 00000100:00100000:2.0:1787832828.287649:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031680 00000100:00100000:2.0:1787832828.288571:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:2.0:1787832828.288591:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:10545:x1874678283031680:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832828.288621:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832828.288651:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068bd expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.288911:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.289069:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 55 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.289098:0:10395:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.289115:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 55 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.289132:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:2.0:1787832828.289136:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832828.289141:0:10395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 55 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832828.289150:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c600, rc 0) 00000100:00100000:2.0:1787832828.289287:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10545:x1874678283031680:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 704us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832828.289298:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 111 00000100:00100000:1.0:1787832828.411892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832828.411943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832828.411996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832828.412036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832828.412075:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031936 00000100:00100000:1.0:1787832828.412086:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031936 00000100:00100000:1.0:1787832828.412171:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032064 00000100:00100000:1.0:1787832828.412175:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032064 00000100:00100000:1.0:1787832828.412195:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1787832828.412204:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283031936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832828.412289:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283031936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 87us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832828.412308:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:2.0:1787832828.412326:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283031808 00000100:00100000:1.0:1787832828.412331:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832828.412334:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283031808 00000100:00100000:1.0:1787832828.412339:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283032064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832828.412369:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283032064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832828.412375:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832828.412383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 292 00000100:00100000:2.0:1787832828.412396:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283031808:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:1.0:1787832828.412396:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832828.412447:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283031808:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 56us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832828.412463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 292 00000100:00100000:0.0:1787832828.413236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032192 00000100:00100000:0.0:1787832828.413245:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032192 00000100:00100000:0.0:1787832828.413317:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:0.0:1787832828.413326:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283032192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832828.413386:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283032192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 61us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832828.413394:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00080000:1.0:1787832828.414327:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832828.621511:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787832829.260328:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787832829.260344:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787832829.260436:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787832829.260444:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787832829.260627:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b392c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300870656:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832829.260805:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565b57b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832829.271779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832829.274466:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b392c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300870656:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787832829.281787:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032320 00000100:00100000:0.0:1787832829.281813:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032320 00000100:00100000:0.0:1787832829.281968:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00100000:0.0:1787832829.281982:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10547:x1874678283032320:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787832829.282029:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787832829.282604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10547:x1874678283032320:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 620us (10835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.282618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 112 00000100:00080000:1.0:1787832829.283387:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832829.291938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.292151:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032448 00000100:00100000:0.0:1787832829.292165:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032448 00000100:00100000:0.0:1787832829.292249:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:0.0:1787832829.292261:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10547:x1874678283032448:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.292374:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.292411:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.292429:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.292645:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.292672:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.292686:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.292869:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.292886:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.292895:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832829.292961:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787832829.292967:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832829.292997:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293011:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293018:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293026:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293034:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.293039:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293048:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293072:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:1.0:1787832829.293075:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832829.293082:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293090:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b743c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293109:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293116:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293122:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293136:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.293140:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293146:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293155:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8c3542b1f900) 00010000:00010000:1.0:1787832829.293157:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832829.293160:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293166:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7443 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293183:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293190:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293197:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293203:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.293206:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293212:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832829.293233:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832829.293237:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.293242:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b744a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.293361:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10547:x1874678283032448:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 1099us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.293800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 113 00000100:00100000:0.0:1787832829.302012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.302112:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032704 00000100:00100000:1.0:1787832829.302121:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032704 00000100:00100000:1.0:1787832829.302183:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:1.0:1787832829.302465:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:10547:x1874678283032704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832829.302488:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832829.302510:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b7451 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.302615:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.302632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.302644:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832829.302655:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787832829.302950:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.302959:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.302965:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303625:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.303630:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303638:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303652:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832829.303655:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787832829.303660:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303666:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303743:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b7451 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068c4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:1.0:1787832829.303757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832829.303761:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b7451 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068c4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.303786:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832829.303861:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283032704:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1668us (1858us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787832829.303871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 114 00000100:00100000:3.0:1787832829.315007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.315150:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283032832 00000100:00100000:1.0:1787832829.315164:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283032832 00000100:00100000:1.0:1787832829.315248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:1.0:1787832829.315259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283032832:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787832829.315313:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787832829.315448:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283032832:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 190us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.315456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1787832829.319695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.320102:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033088 00000100:00100000:0.0:1787832829.320116:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033088 00000100:00100000:0.0:1787832829.320232:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787832829.320245:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283033088:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.320286:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832829.320291:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787832829.320343:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b73f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068a8 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.320371:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832829.320379:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832829.320418:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7466 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068cb expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787832829.321166:0:10395:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787832829.321470:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b746d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.321490:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.321504:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.321587:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7466 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068cb expref: 58 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.321627:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b746d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068cb expref: 57 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.321637:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f000) 00010000:00010000:0.0:1787832829.321640:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832829.321643:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832829.321782:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:10547:x1874678283033088:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1539us (2103us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787832829.321792:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787832829.333036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.333221:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033344 00000100:00100000:3.0:1787832829.333235:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033344 00000100:00100000:3.0:1787832829.333310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787832829.333322:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:10547:x1874678283033344:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832829.333412:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832829.333448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b746d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068cb expref: 57 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.333481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f000) 00010000:00010000:3.0:1787832829.333495:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832829.333523:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.333542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.333554:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334166:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334193:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334209:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334319:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334327:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334334:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334341:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832829.334345:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334354:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334369:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:3.0:1787832829.334373:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832829.334379:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334385:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b747b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334411:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334418:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334425:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334436:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832829.334439:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334445:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334454:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3a83c222 (ffff8c3543a9cb00) 00010000:00010000:3.0:1787832829.334456:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832829.334459:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.334465:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7482 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3a83c222 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.334579:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283033344:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1254us (1554us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832829.334589:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:2.0:1787832829.341823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.341946:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033472 00000100:00100000:0.0:1787832829.341957:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033472 00000100:00100000:0.0:1787832829.342022:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1787832829.342033:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:10547:x1874678283033472:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.342054:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832829.342079:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7489 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068d2 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342118:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342133:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342146:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342271:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 58 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342289:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 57 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.342298:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:0.0:1787832829.342301:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787832829.342305:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:0.0:1787832829.342377:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:10547:x1874678283033472:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 346us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.342384:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:1.0:1787832829.349188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.350374:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033728 00000100:00100000:3.0:1787832829.350386:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033728 00000100:00100000:3.0:1787832829.350629:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1787832829.350642:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:10547:x1874678283033728:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832829.350776:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.350797:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.350809:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832829.351106:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787832829.351118:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352379414597ns, next at 353379411902ns, rc = 0 00000004:00010000:3.0:1787832829.351212:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a2d1d30 reply state 00000000f04603f2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.351221:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832829.351987:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:10547:x1874678283033728:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1345us (2809us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787832829.351997:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00010000:00010000:3.0:1787832829.373228:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373247:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373256:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373262:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832829.373268:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373276:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373295:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:3.0:1787832829.373298:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787832829.373304:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.373337:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b7497 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.378778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.378922:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033856 00000100:00100000:0.0:1787832829.378933:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033856 00000100:00100000:0.0:1787832829.378997:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1787832829.379008:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+58:10547:x1874678283033856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.379034:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832829.379054:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068d9 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.379116:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 59 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.379130:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 59 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.379169:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:0.0:1787832829.379172:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787832829.379177:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832829.379246:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:10547:x1874678283033856:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 240us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.379254:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:2.0:1787832829.382098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.382199:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283033984 00000100:00100000:1.0:1787832829.382212:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283033984 00000100:00100000:1.0:1787832829.382293:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1787832829.382305:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283033984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787832829.382772:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283033984:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 468us (684us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787832829.382779:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1787832829.393935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.394275:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283034240 00000100:00100000:3.0:1787832829.394286:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283034240 00000100:00100000:3.0:1787832829.394351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:3.0:1787832829.394362:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:10547:x1874678283034240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787832829.394646:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:10547:x1874678283034240:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 286us (724us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787832829.394654:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832829.402807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.402944:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283034496 00000100:00100000:0.0:1787832829.402954:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283034496 00000100:00100000:0.0:1787832829.403014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787832829.403022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:10547:x1874678283034496:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787832829.403134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:10547:x1874678283034496:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.403141:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:0.0:1787832829.410949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832829.411096:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283034624 00000100:00100000:2.0:1787832829.411106:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283034624 00000100:00100000:0.0:1787832829.411295:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:0.0:1787832829.411307:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:10547:x1874678283034624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.411335:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832829.411360:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068e0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.411446:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.411959:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.411990:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832829.412030:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832829.412049:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.412079:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e0 expref: 62 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.412099:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e0 expref: 61 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.412108:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:0.0:1787832829.412111:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787832829.412114:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832829.412220:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:10547:x1874678283034624:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 915us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.412229:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 122 00000100:00100000:2.0:1787832829.418208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.418291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283034752 00000100:00100000:3.0:1787832829.418301:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283034752 00000100:00100000:3.0:1787832829.418393:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1787832829.418412:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283034752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832829.418430:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832829.418453:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068e7 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832829.418611:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9029fd, blocks: 0x1 00010000:00010000:3.0:1787832829.418633:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1787832829.418638:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832829.418648:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.418672:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.418733:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86a00, rc 0) 00000100:00100000:3.0:1787832829.418797:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283034752:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 387us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832829.418804:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:2.0:1787832829.425075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.425172:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035008 00000100:00100000:0.0:1787832829.425184:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035008 00000100:00100000:0.0:1787832829.425256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:0.0:1787832829.425267:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:10547:x1874678283035008:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787832829.425381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:10547:x1874678283035008:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.425389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1787832829.431893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832829.432053:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035136 00000100:00100000:2.0:1787832829.432063:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035136 00000100:00100000:2.0:1787832829.432126:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:2.0:1787832829.432136:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:10547:x1874678283035136:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832829.432158:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832829.432177:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068ee expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.432208:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.432218:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832829.432222:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832829.432228:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.432278:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.432292:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 9 pid: 6695 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832829.432306:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874678300870784:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832829.432427:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832829.454885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.455103:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035264 00000100:00100000:0.0:1787832829.455127:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035264 00010000:00010000:0.0:1787832829.455171:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 10 pid: 6695 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.455220:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1787832829.455230:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b847c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2352:x1874678283035264:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832829.455247:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832829.455272:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 10 pid: 6695 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.455288:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 10 pid: 6695 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.455320:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832829.455326:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832829.455337:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.455348:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.455387:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.455412:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1874678300870912:192.168.201.34@tcp:105: 00000100:00100000:0.0:1787832829.455526:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35465243c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787832829.455818:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b74b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e7 expref: 10 pid: 6695 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.455845:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874678300870784:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832829.455872:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.455882:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d600, rc 0) 00000100:00100000:1.0:1787832829.455926:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:10547:x1874678283035136:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 23792us (24044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.455935:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1787832829.465110:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1874678300870912:192.168.201.34@tcp:105: 00010000:00010000:0.0:1787832829.465141:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832829.465233:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b847c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283035264:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 10002us (10359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.465248:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1787832829.469832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.469946:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035392 00000100:00100000:0.0:1787832829.469956:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035392 00002000:00100000:0.0:1787832829.470078:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c3565b07c00 x1874678283035392/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:390/0 lens 504/0 e 0 to 0 dl 1787832840 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832829.470090:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565b07c00 with x1874678283035392 ext(0->12) 00002000:00010000:0.0:1787832829.470097:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565b07c00 00000100:00100000:0.0:1787832829.470186:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787832829.470196:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283035392:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787832829.472286:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283035392:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 2081us (2454us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787832829.472302:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:0.0:1787832829.472316:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c3565b07c00 x1874678283035392/t4294967309(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:390/0 lens 504/448 e 0 to 0 dl 1787832840 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832829.472327:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3565b07c00 with x1874678283035392 ext(0->12) 00002000:00010000:0.0:1787832829.472333:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3565b07c00 00000100:00100000:2.0:1787832829.478912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.479958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035520 00000100:00100000:1.0:1787832829.479974:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035520 00000100:00100000:1.0:1787832829.480067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:1.0:1787832829.480077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:10547:x1874678283035520:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787832829.636839:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:0.0:1787832829.637207:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c354859db40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787832829.637216:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c354859d3c0 00000020:00080000:0.0:1787832829.637221:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3548bb7400 00000004:00080000:0.0:1787832829.637249:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787832829.637299:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c354859d0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787832829.637303:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c354859d600 00000020:00080000:0.0:1787832829.637306:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b4e9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3565b51000 00000001:00080000:0.0:1787832829.637444:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787832829.637450:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787832829.637458:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787832829.637778:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300871040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787832829.637872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832829.638080:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300871296:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1787832829.638276:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787832829.638543:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787832829.638788:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832829.638799:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300871168:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787832829.639768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832829.639980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10547:x1874678283035520:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 159898us (161073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.639996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 124 00000100:00100000:2.0:1787832829.640638:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300871040 00000100:00100000:2.0:1787832829.640656:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300871040 00000100:00100000:2.0:1787832829.640761:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300871296 00000100:00100000:2.0:1787832829.640765:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300871296 00000100:00100000:2.0:1787832829.640798:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787832829.640809:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300871040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787832829.640848:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787832829.640907:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9029fb, atime: 0x6a9029fc, ctime: 0x6a9029fb, blocks: 0x1 00010000:00010000:2.0:1787832829.640917:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.640962:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787832829.640967:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832829.640975:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.640994:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.641005:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.641013:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.641034:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787832829.641449:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787832829.641461:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300871296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787832829.641647:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787832829.641651:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787832830 00002000:00010000:3.0:1787832829.641653:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787832829.641655:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787832829 -> 1787832830 00002000:00010000:3.0:1787832829.641658:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787832829.641765:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300871296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (2002us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787832829.641774:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787832829.641834:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787832829.641841:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1787832829.641869:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c354b719a40 x1874678300871296/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787832845 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787832829.641884:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c354b719a40/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787832829.641890:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300871296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787832829.642576:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300871040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1766us (4701us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787832829.642586:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787832829.642733:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787832829.642740:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787832829.642840:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832829.642860:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.642874:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832829.642878:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.642890:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.642926:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.642935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055da5aef/0x72bd9178b14b74c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.642961:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832829.642963:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832829.642965:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832829.644188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787832829.644283:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c3560c81a40/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787832829.644292:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300871040:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787832829.644510:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300871168 00000100:00100000:3.0:1787832829.644519:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300871168 00000100:00100000:3.0:1787832829.644583:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787832829.644601:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300871168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787832829.644637:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787832829.644669:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.644697:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.644754:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787832829.644759:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832829.644765:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.644834:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.644852:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 9 pid: 6696 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.644871:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300871424:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832829.645222:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35465243c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787832829.646103:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832829.648610:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565f6fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300871424:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832829.648655:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.649653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.649882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.650119:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035776 00000100:00100000:0.0:1787832829.650131:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035776 00000100:00100000:0.0:1787832829.650209:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1787832829.650222:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2354:x1874678283035776:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787832829.654043:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283035648 00000100:00100000:1.0:1787832829.654064:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283035648 00010000:00010000:1.0:1787832829.654127:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 11 pid: 6696 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.654187:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:1.0:1787832829.654198:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:2353:x1874678283035648:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832829.654239:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832829.654248:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 11 pid: 6696 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.654266:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 11 pid: 6696 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.654635:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7283 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70684d expref: 11 pid: 6696 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.654661:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832829.654666:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832829.654672:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.654685:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.654780:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832829.654864:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283035648:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 667us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.654874:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00010000:00010000:0.0:1787832829.655069:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.655080:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.655092:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.655118:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.655154:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787832829.658739:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300871168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14133us (14542us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787832829.658756:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1787832829.660126:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c3560ce2580/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787832829.660142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300871168:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787832829.660322:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832829.660335:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.660374:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832829.660380:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.660402:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.660429:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.660438:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b74c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.660464:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832829.660465:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832829.660467:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787832829.688104:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787832829.688131:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1787832829.688286:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678283035776:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 38060us (38397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832829.688300:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787832829.691790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.692136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036032 00000100:00100000:0.0:1787832829.692146:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036032 00000100:00100000:0.0:1787832829.692211:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:0.0:1787832829.692224:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10547:x1874678283036032:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.692278:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832829.692306:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b74ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068e0 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.692325:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:0.0:1787832829.692330:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832829.692361:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.692376:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.692387:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832829.692671:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d65c15d8 reply state 00000000d54e9e1c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.692747:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832829.692850:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:10547:x1874678283036032:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 629us (1072us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787832829.692858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 125 00000100:00100000:3.0:1787832829.696192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:0.0:1787832829.696336:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696349:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696357:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696363:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832829.696367:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696376:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696402:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:0.0:1787832829.696406:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832829.696411:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.696417:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.696500:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036160 00000100:00100000:1.0:1787832829.696509:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036160 00000100:00100000:1.0:1787832829.696560:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787832829.696571:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283036160:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787832829.696834:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787832829.696838:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787832830 -> 1787832828 00002000:00010000:1.0:1787832829.696841:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787832828 00002000:00010000:1.0:1787832829.696844:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787832830 -> 1787832828 00002000:00010000:1.0:1787832829.696846:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787832829.696908:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283036160:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 338us (726us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787832829.696917:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:2.0:1787832829.706894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.707008:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036416 00000100:00100000:0.0:1787832829.707018:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036416 00000100:00100000:0.0:1787832829.707084:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:0.0:1787832829.707094:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10547:x1874678283036416:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.707159:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.707176:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.707187:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.707218:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.707233:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 15 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.707248:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300871552:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832829.707337:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832829.709654:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300871552:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832829.709682:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832829.710366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.710453:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036544 00000100:00100000:3.0:1787832829.710478:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036544 00010000:00010000:3.0:1787832829.710513:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.710557:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787832829.710566:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:2352:x1874678283036544:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832829.710582:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832829.710589:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710601:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710620:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d2 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710636:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:3.0:1787832829.710641:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710650:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.710690:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832829.710796:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710803:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710832:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710840:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710848:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710854:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832829.710858:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710867:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710876:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:2.0:1787832829.710880:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787832829.710884:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.710890:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832829.710965:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:10547:x1874678283036416:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 3871us (4080us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787832829.710984:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 126 00000100:00100000:3.0:1787832829.711311:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2352:x1874678283036544:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 745us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832829.711329:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:2.0:1787832829.713930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.714024:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036672 00000100:00100000:0.0:1787832829.714035:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036672 00000100:00100000:0.0:1787832829.714091:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1787832829.714099:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283036672:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.714140:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.714170:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.714178:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832829.714182:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832829.714187:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.714223:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.714236:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 7 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.714253:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300871680:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832829.714340:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832829.717643:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.717747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283036800 00000100:00100000:3.0:1787832829.717756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283036800 00010000:00010000:3.0:1787832829.717796:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 8 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.717829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1787832829.717839:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283036800:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832829.717854:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832829.717877:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 8 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.717891:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 8 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.717914:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832829.717918:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832829.717923:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.717933:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.717952:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832829.718008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283036800:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832829.718030:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00010000:00010000:0.0:1787832829.718573:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f8c941/0x72bd9178b14b74ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068ee expref: 7 pid: 6697 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.718588:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300871680:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832829.718609:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718620:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718635:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718660:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718668:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718677:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718695:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832829.718924:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718935:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718949:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.718956:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b74dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.719123:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283036672:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 5023us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.719132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1787832829.727215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832829.727315:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037056 00000100:00100000:0.0:1787832829.727325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037056 00000100:00100000:0.0:1787832829.727440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 127 00000100:00100000:0.0:1787832829.727453:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10547:x1874678283037056:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787832829.727545:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727565:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727576:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727827:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727839:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727847:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727879:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.727911:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 15 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.727926:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300871808:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832829.728214:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832829.732204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.732283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037184 00000100:00100000:1.0:1787832829.732293:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037184 00010000:00010000:1.0:1787832829.732330:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.732369:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1787832829.732378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:2353:x1874678283037184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832829.732403:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832829.732409:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.732422:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 16 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.732443:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:1.0:1787832829.732447:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.732463:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.732472:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.732490:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832829.732671:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:2353:x1874678283037184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 292us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.732733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00010000:00010000:0.0:1787832829.733096:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b749e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068d9 expref: 15 pid: 10395 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.733113:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300871808:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832829.733139:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.733149:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.733155:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832829.733367:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787832829.733789:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787832829.733836:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787832829.733920:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874678300871936:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787832829.733978:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832829.734146:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787832829.734216:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300871936 00000100:00100000:1.0:1787832829.734223:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300871936 00000100:00100000:1.0:1787832829.734267:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787832829.734275:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874678300871936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787832829.734348:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874678300871936:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.734355:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787832829.734432:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787832829.734437:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c354b719a40, transno 4294967310 00000100:00100000:0.0:1787832829.734467:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c3560ce2580 x1874678300871168/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787832845 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832829.734488:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874678300871936:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787832829.735934:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787832829.736112:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874678300872064:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787832829.736166:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832829.736417:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c344259c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832829.737804:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300872064 00000100:00100000:1.0:1787832829.737815:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300872064 00000100:00100000:1.0:1787832829.737908:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787832829.737917:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874678300872064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787832829.738270:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1874678300872064:12345-0@lo:1000:mdt00_000.0 Request processed in 354us (2103us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787832829.738279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787832829.738358:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874678300872064:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787832829.738413:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738424:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738431:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738437:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832829.738442:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738450:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738530:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3542b1f600) 00010000:00010000:2.0:1787832829.738534:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832829.738539:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738546:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b74eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738674:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738680:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738685:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832829.738688:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738695:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738830:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:2.0:1787832829.738833:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832829.738840:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 18 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738852:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 18 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738862:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 18 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832829.738896:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 18 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832829.738923:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf66940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300872192:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787832829.739347:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832829.747679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.747906:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf66940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300872192:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787832829.747932:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.747942:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b742e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.747976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.747990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748029:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748039:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748046:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748053:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748058:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.748062:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748069:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748080:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832829.748082:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832829.748086:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748092:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b74f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748103:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748108:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748120:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748125:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832829.748128:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748135:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748143:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832829.748145:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787832829.748148:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.748152:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b74e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.748885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037312 00000100:00100000:3.0:1787832829.748895:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037312 00000100:00100000:3.0:1787832829.748949:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:3.0:1787832829.748959:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10545:x1874678283037312:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:1.0:1787832829.749945:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:10547:x1874678283037056:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 22490us (22736us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787832829.749956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 127 00000020:00080000:1.0:1787832829.749963:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787832829.752915:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832829.752923:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832829.753887:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787832829.753902:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787832829.754261:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10545:x1874678283037312:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 5297us (6590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832829.754275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1787832829.754558:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.757755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037568 00000100:00100000:1.0:1787832829.757772:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037568 00000100:00100000:1.0:1787832829.757834:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1787832829.757845:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:10547:x1874678283037568:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787832829.759381:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787832829.759524:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787832829.759670:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759689:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759732:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759742:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759749:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759756:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.759779:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787832829.759911:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832829.759919:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.759926:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832829.759930:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.759938:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.759951:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3543c5a000) 00010000:00010000:3.0:1787832829.759954:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787832829.759958:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.759964:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b74f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.759982:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832829.759984:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832829.760160:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832829.760281:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10547:x1874678283037568:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 2434us (5721us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787832829.760292:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000020:00080000:1.0:1787832829.760298:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787832829.760435:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.762281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037824 00000100:00100000:1.0:1787832829.762293:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037824 00000100:00100000:1.0:1787832829.762350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:1.0:1787832829.762360:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10545:x1874678283037824:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:1.0:1787832829.762850:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787832829.762927:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10545:x1874678283037824:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 568us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.762936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 128 00000100:00100000:0.0:1787832829.796075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.796264:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283037952 00000100:00100000:3.0:1787832829.796274:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283037952 00000100:00100000:3.0:1787832829.796334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 129 00000100:00100000:3.0:1787832829.796344:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:10549:x1874678283037952:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832829.796368:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832829.796389:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068f5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796464:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796479:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796490:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796503:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796510:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796517:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796889:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796901:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796917:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796952:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832829.796965:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 21 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832829.796979:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300872320:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832829.798429:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542b60f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832829.803528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832829.803607:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283038208 00000100:00100000:3.0:1787832829.803616:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283038208 00000100:00100000:3.0:1787832829.803672:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1787832829.803698:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:5594:x1874678283038208:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787832829.803965:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:5594:x1874678283038208:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 284us (447us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787832829.803974:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1787832829.808387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832829.808505:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283038336 00000100:00100000:1.0:1787832829.808514:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283038336 00010000:00010000:1.0:1787832829.808554:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 23 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832829.808601:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832829.808610:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573a69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:2353:x1874678283038336:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832829.808626:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832829.808632:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 23 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.808646:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 23 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.808668:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832829.808674:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.808697:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.808949:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832829.808982:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832829.809113:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573a69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:2353:x1874678283038336:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 502us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832829.809122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00010000:00010000:0.0:1787832829.811167:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b7420 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068b6 expref: 22 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832829.811192:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300872320:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832829.811213:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811223:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811229:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832829.811277:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787832829.811282:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832829.811302:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811317:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811347:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811353:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811360:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811364:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832829.811368:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811376:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811399:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:0.0:1787832829.811403:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832829.811407:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811412:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b7507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811423:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811428:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811434:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811444:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832829.811447:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811453:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811460:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3543a9c600) 00010000:00010000:0.0:1787832829.811471:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832829.811474:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811480:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b750e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811526:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b7500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068f5 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811540:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068f5 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832829.811547:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832829.811549:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832829.811551:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87800, rc 0) 00000100:00100000:0.0:1787832829.811697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10549:x1874678283037952:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 15337us (15615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832829.811733:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 129 00010000:00010000:2.0:1787832830.667966:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832830.734126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300872448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832830.734204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832830.737489:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300872448 00000100:00100000:3.0:1787832830.737505:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300872448 00000100:00100000:3.0:1787832830.737568:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787832830.737589:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300872448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832830.737616:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787832830.737695:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300872448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832830.737732:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787832830.737800:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300872448:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787832830.795895:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832830.795906:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832830.795970:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787832830.795978:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787832830.796113:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c355cf670c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300872576:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787832830.796216:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832830.806245:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c355cf670c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300872576:192.168.201.34@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1787832830.817682:0:12113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832830.817691:0:12113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832830.817763:0:12113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787832830.817771:0:12113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787832830.822063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832830.822183:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283038464 00000100:00100000:3.0:1787832830.822192:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283038464 00000100:00100000:3.0:1787832830.822250:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:3.0:1787832830.822272:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10561:x1874678283038464:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787832830.822307:0:10395:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787832830.822421:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10561:x1874678283038464:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 151us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832830.822429:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 130 00000100:00100000:1.0:1787832830.835742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832830.835781:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283038720 00000100:00100000:1.0:1787832830.835790:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283038720 00000100:00100000:1.0:1787832830.835842:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:1.0:1787832830.835852:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:10561:x1874678283038720:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832830.835872:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832830.835891:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b751c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7068fc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832830.835998:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832830.836012:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832830.836023:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832830.836034:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787832830.836157:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b751c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068fc expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832830.836172:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068fc expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832830.836181:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832830.836184:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832830.836187:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40a00, rc 0) 00000100:00100000:1.0:1787832830.836251:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10561:x1874678283038720:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 400us (519us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787832830.836258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 131 00000100:00100000:2.0:1787832830.855827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832830.855945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832830.855980:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283039104 00000100:00100000:0.0:1787832830.856077:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283038976 00000100:00100000:0.0:1787832830.856093:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283038976 00000100:00100000:0.0:1787832830.856148:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 132 00000100:00100000:0.0:1787832830.856157:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10561:x1874678283038976:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787832830.856237:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856266:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856280:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856468:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856476:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856483:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856489:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832830.856493:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856501:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856513:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832830.856516:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787832830.856520:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832830.856535:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832830.856682:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10561:x1874678283038976:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 525us (866us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787832830.856692:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 132 00000040:00080000:0.0:1787832830.856812:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787832830.856817:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787832830.857284:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787832830.857292:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787832830.857742:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283039104 00000100:00100000:2.0:1787832830.857814:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787832830.857824:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:2355:x1874678283039104:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832830.857837:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832830.857857:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068fc expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832830.857882:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:2.0:1787832830.857887:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832830.857924:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:2355:x1874678283039104:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 102us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832830.857932:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787832830.860666:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832830.861077:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283039360 00000100:00100000:3.0:1787832830.861086:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283039360 00000100:00100000:3.0:1787832830.861404:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:3.0:1787832830.861416:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:10561:x1874678283039360:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787832830.861659:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10561:x1874678283039360:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 245us (1002us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787832830.861666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787832831.245690:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832831.245734:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300872704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832831.245806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832831.246097:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300872704 00000100:00100000:0.0:1787832831.246105:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300872704 00000100:00100000:0.0:1787832831.246169:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787832831.246180:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300872704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832831.246226:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832831.246273:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300872704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832831.246280:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787832831.246579:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832831.246616:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300872704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832831.250544:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300873088:0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.250614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832831.250662:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832831.250667:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300872960:0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.250722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832831.250751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873088 00000100:00100000:3.0:1787832831.250758:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873088 00000100:00100000:3.0:1787832831.250810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300872960 00000100:00100000:3.0:1787832831.250813:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300872960 00000100:00100000:3.0:1787832831.250829:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787832831.250837:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300873088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.250883:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300873088:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832831.250891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787832831.250907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787832831.250913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300872960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.250932:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300872960:12345-0@lo:400:kworker.0 Request processed in 20us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832831.250938:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1787832831.250950:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832831.250975:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300872960:0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.250984:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300873088:0@lo:400:kworker.0 00000100:00100000:1.0:1787832831.251056:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300872832:0@lo:400:kworker.0 00000100:00100000:1.0:1787832831.251085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832831.251115:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300873344:0@lo:400:kworker.0 00000100:00100000:1.0:1787832831.251133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832831.251145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832831.251149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300873216:0@lo:400:kworker.0 00000100:00100000:1.0:1787832831.251167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832831.251188:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873216 00000100:00100000:1.0:1787832831.251191:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873216 00000100:00100000:1.0:1787832831.251228:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787832831.251234:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300873216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832831.251265:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300873216:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832831.251270:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787832831.251290:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300873216:0@lo:400:kworker.0 00000100:00100000:0.0:1787832831.252858:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873344 00000100:00100000:0.0:1787832831.252869:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873344 00000100:00100000:0.0:1787832831.252916:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787832831.252923:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300873344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832831.252984:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300873344:12345-0@lo:400:kworker.0 Request processed in 62us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832831.252990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787832831.253116:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300873344:0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.254128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300872832 00000100:00100000:3.0:1787832831.254135:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300872832 00000100:00100000:3.0:1787832831.254181:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787832831.254189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300872832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832831.254262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300872832:12345-0@lo:400:kworker.0 Request processed in 74us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832831.254269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1787832831.254305:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787832831.254324:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832831.254406:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300872832:0@lo:400:kworker.0 00010000:00010000:1.0:1787832831.692162:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787832832.350986:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787832832.351164:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787832832.351272:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787832832.715922:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787832832.850921:0:12166:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787832832.850942:0:12166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787832832.852408:0:12166:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787832832.852426:0:12166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787832833.055421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832833.055918:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283039616 00000100:00100000:0.0:1787832833.055931:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283039616 00000100:00100000:0.0:1787832833.056038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:0.0:1787832833.056050:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:10582:x1874678283039616:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832833.056083:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832833.056110:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706903 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832833.056499:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b753f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832833.056520:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b753f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832833.056537:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b753f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832833.056551:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787832833.056917:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706903 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832833.056944:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b753f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706903 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832833.056954:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:0.0:1787832833.056958:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787832833.056978:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030400, rc 0) 00000100:00080000:3.0:1787832833.057363:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832833.057418:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:10582:x1874678283039616:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1369us (2012us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787832833.057429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 133 00000100:00100000:0.0:1787832833.065402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832833.065562:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283039744 00000100:00100000:1.0:1787832833.065576:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283039744 00000100:00100000:1.0:1787832833.066182:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:1.0:1787832833.066197:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:10582:x1874678283039744:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:1.0:1787832833.066766:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066790:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066804:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066839:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066846:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066854:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066860:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832833.066865:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066874:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066903:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832833.066906:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832833.066912:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832833.066920:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b754d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832833.068126:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:10582:x1874678283039744:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 1920us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832833.068141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 134 00000100:00100000:3.0:1787832833.162924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832833.162995:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283039872 00000100:00100000:3.0:1787832833.163017:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283039872 00000100:00100000:3.0:1787832833.163103:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1787832833.163116:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678283039872:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1787832833.163143:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832833.163174:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7554 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70690a expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832833.163221:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9029fc, atime: 0x6a9029fc, ctime: 0x6a9029fc, blocks: 0xb 00010000:00010000:3.0:1787832833.163250:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1787832833.163257:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832833.163270:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70690a expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832833.163295:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70690a expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832833.163312:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86a00, rc 0) 00000100:00100000:3.0:1787832833.163396:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2355:x1874678283039872:12345-192.168.201.34@tcp:101:cat.0 Request processed in 283us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832833.163405:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00080000:3.0:1787832833.163571:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832833.168374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832833.170142:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040000 00000100:00100000:0.0:1787832833.170159:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040000 00002000:00100000:0.0:1787832833.170293:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c357b898b40 x1874678283040000/t0(0) o3->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:394/0 lens 488/0 e 0 to 0 dl 1787832844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832833.170306:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b898b40 with x1874678283040000 ext(0->4095) 00002000:00010000:0.0:1787832833.170312:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b898b40 00000100:00100000:0.0:1787832833.170361:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787832833.170373:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283040000:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:0.0:1787832833.175070:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283040000:12345-192.168.201.34@tcp:3:cat.0 Request processed in 4681us (6693us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787832833.175088:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00002000:00100000:0.0:1787832833.175102:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c357b898b40 x1874678283040000/t0(0) o3->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:394/0 lens 488/4536 e 0 to 0 dl 1787832844 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832833.175115:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b898b40 with x1874678283040000 ext(0->4095) 00002000:00010000:0.0:1787832833.175124:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b898b40 00000100:00100000:3.0:1787832833.536095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832833.536143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832833.536270:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040256 00000100:00100000:1.0:1787832833.536282:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040256 00000100:00100000:1.0:1787832833.536397:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:1.0:1787832833.536410:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283040256:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:0.0:1787832833.536419:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832833.536522:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283040256:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832833.536531:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1787832833.538876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832833.539670:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040384 00000100:00100000:1.0:1787832833.539685:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040384 00000100:00080000:0.0:1787832833.539798:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832833.539834:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:1.0:1787832833.539848:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283040384:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832833.539977:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283040384:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 133us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832833.539987:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:2.0:1787832833.542162:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040128 00000100:00100000:2.0:1787832833.542182:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040128 00000100:00100000:2.0:1787832833.542285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 294 00000100:00100000:2.0:1787832833.542298:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283040128:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832833.542416:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283040128:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 120us (6270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832833.542424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 294 00010000:00010000:2.0:1787832833.743248:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832834.766131:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787832834.942163:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787832834.942205:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787832834.942213:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787832834.942616:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787832834.942636:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c344259c180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787832834.942643:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3442940100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c344259c0c0 00000020:00080000:0.0:1787832834.942646:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3442940800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3441b89400 00000020:00080000:0.0:1787832834.942696:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787832834.942739:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787832834.942971:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1787832835.792889:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832835.852182:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300873472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832835.852283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832835.852442:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873472 00000100:00100000:0.0:1787832835.852454:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873472 00000100:00100000:0.0:1787832835.852542:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787832835.852554:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300873472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787832835.852608:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832835.852672:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300873472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832835.852680:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787832835.852765:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787832835.852772:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c3560ce2580, transno 4294967311 00000004:00080000:0.0:1787832835.852786:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1787832835.852822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300873472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787832835.853437:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787832835.983907:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832835.983916:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832835.983962:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787832835.983971:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787832836.364090:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300873600:0@lo:400:kworker.0 00000100:00100000:1.0:1787832836.364195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832836.365609:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300873984:0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.365679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832836.365886:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300873728:0@lo:400:kworker.0 00000100:00100000:2.0:1787832836.365928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832836.365965:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832836.365971:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300873856:0@lo:400:kworker.0 00000100:00100000:2.0:1787832836.365994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832836.370517:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873728 00000100:00100000:0.0:1787832836.370538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873728 00000100:00100000:0.0:1787832836.370630:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873856 00000100:00100000:0.0:1787832836.370634:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873856 00000100:00100000:0.0:1787832836.370685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787832836.370697:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300873728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.370866:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300873728:12345-0@lo:400:kworker.0 Request processed in 171us (4936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832836.370875:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787832836.370898:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787832836.370913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300873856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.370948:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300873856:12345-0@lo:400:kworker.0 Request processed in 36us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832836.370955:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787832836.371012:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300873856:0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.371027:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300873728:0@lo:400:kworker.0 00000100:00100000:1.0:1787832836.372409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873600 00000100:00100000:1.0:1787832836.372422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873600 00000100:00100000:1.0:1787832836.372472:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787832836.372600:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300873600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832836.372686:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300873600:12345-0@lo:400:kworker.0 Request processed in 91us (8492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832836.372694:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787832836.373598:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300873600:0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.373820:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832836.374175:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300874112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832836.374251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787832836.374468:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832836.374944:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874112 00000100:00100000:1.0:1787832836.374954:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874112 00000100:00100000:1.0:1787832836.375019:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832836.375030:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300874112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832836.375073:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832836.375139:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300874112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832836.375146:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832836.375191:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787832836.375199:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787832836.375223:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c3560c81a40, transno 4294967304 00000100:00100000:1.0:1787832836.375244:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300874112:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787832836.375577:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832836.375596:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300873984 00000100:00100000:3.0:1787832836.375600:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300873984 00000100:00100000:3.0:1787832836.375639:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832836.375646:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300873984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832836.375726:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300873984:12345-0@lo:400:kworker.0 Request processed in 81us (10047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832836.375733:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787832836.376827:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300873984:0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.379189:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b86de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300874240:0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.379294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832836.379751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874240 00000100:00100000:0.0:1787832836.379761:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874240 00000100:00080000:2.0:1787832836.379953:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832836.383656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787832836.383679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300874240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832836.383996:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300874240:12345-0@lo:400:kworker.0 Request processed in 325us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832836.384006:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787832836.384075:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b86de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300874240:0@lo:400:kworker.0 00010000:00010000:3.0:1787832836.819804:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832837.840643:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832838.654036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.654098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.654147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.654179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.654216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.654271:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041024 00000100:00100000:1.0:1787832838.654282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040640 00000100:00100000:3.0:1787832838.654285:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041024 00000100:00100000:1.0:1787832838.654286:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040640 00000100:00100000:3.0:1787832838.654368:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:2.0:1787832838.654377:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040512 00000100:00100000:3.0:1787832838.654381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283041024:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832838.654381:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040512 00000100:00100000:2.0:1787832838.654417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 296 00000100:00100000:2.0:1787832838.654424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283040512:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832838.654537:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2352:x1874678283040512:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 112us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832838.654546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 296 00000100:00100000:3.0:1787832838.654563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283041024:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 186us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832838.654570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1787832838.654595:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040768 00000100:00100000:0.0:1787832838.654630:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040768 00000100:00100000:0.0:1787832838.654673:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283040896 00000100:00100000:0.0:1787832838.654675:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283040896 00000100:00100000:0.0:1787832838.654697:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1787832838.654751:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b86de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283040768:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832838.654785:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b86de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283040768:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832838.654791:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1787832838.654815:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:0.0:1787832838.654822:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283040896:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832838.654856:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283040896:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832838.654863:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00080000:2.0:1787832838.654912:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787832838.654918:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787832838.654920:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832838.655022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:1.0:1787832838.655036:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2352:x1874678283040640:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832838.655074:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2352:x1874678283040640:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832838.655086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:2.0:1787832838.656422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832838.657940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041152 00000100:00100000:1.0:1787832838.657958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041152 00000100:00100000:1.0:1787832838.658061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:1.0:1787832838.658074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10226:x1874678283041152:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787832838.658217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10226:x1874678283041152:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 145us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832838.658227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 135 00000100:00100000:2.0:1787832838.667485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832838.667590:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041408 00000100:00100000:3.0:1787832838.667607:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041408 00000100:00100000:3.0:1787832838.667759:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:3.0:1787832838.667774:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:10226:x1874678283041408:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787832838.668605:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:10226:x1874678283041408:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 828us (1130us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787832838.678614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00010000:00010000:3.0:1787832838.860151:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832838.998142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832838.998904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041536 00000100:00100000:0.0:1787832838.998918:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041536 00000100:00100000:0.0:1787832838.999000:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 136 00000100:00100000:0.0:1787832838.999013:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:11035:x1874678283041536:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:0.0:1787832838.999045:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832838.999075:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b755b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706911 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999160:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999179:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999196:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832838.999497:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787832838.999511:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832838.999631:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999668:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b755b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999693:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832838.999790:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:0.0:1787832838.999795:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832838.999799:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:1.0:1787832838.999943:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:11035:x1874678283041536:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 931us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832838.999951:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 136 00010000:00010000:3.0:1787832839.884391:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787832840.071532:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787832840.071578:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787832840.072064:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787832840.072079:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787832840.908242:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832840.974029:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832840.974063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300874368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832840.974170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832840.974537:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874368 00000100:00100000:0.0:1787832840.974549:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874368 00000100:00100000:0.0:1787832840.974634:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787832840.974646:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300874368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787832840.974700:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832840.974792:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300874368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832840.974800:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787832840.974979:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832840.975029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300874368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832841.486205:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300874496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832841.486311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832841.487329:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874496 00000100:00100000:3.0:1787832841.487345:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874496 00000100:00100000:3.0:1787832841.487444:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787832841.487457:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300874496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832841.487506:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832841.487604:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300874496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832841.487613:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787832841.487814:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832841.487869:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300874496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832841.489781:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300874880:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.489878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832841.489949:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832841.489975:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300874752:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832841.490043:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300875008:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832841.490090:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832841.490095:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300874624:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832841.490159:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874880 00000100:00100000:1.0:1787832841.490168:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874880 00000100:00100000:1.0:1787832841.490243:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874752 00000100:00100000:1.0:1787832841.490247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874752 00000100:00100000:1.0:1787832841.490262:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875008 00000100:00100000:1.0:1787832841.490264:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875008 00000100:00100000:1.0:1787832841.490284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787832841.490293:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300874880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490359:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300874880:12345-0@lo:400:kworker.0 Request processed in 66us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832841.490368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787832841.490398:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787832841.490405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300874752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300874752:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832841.490440:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787832841.490453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787832841.490460:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300875008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490491:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300875008:12345-0@lo:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832841.490508:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787832841.490529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300874624 00000100:00100000:1.0:1787832841.490533:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300874624 00000100:00100000:1.0:1787832841.490571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787832841.490579:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300874624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490611:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3307:x1874678300874624:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832841.490617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1787832841.490650:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832841.490684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300874752:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b898780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300874880:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490778:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:204f2893-acc1-48f1-8f52-36a94d59ea17:3307:1874678300874624:0@lo:400:kworker.0 00000100:00100000:1.0:1787832841.490788:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b89b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300875008:0@lo:400:kworker.0 00010000:00010000:0.0:1787832841.934943:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832842.965959:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787832842.967596:0:12369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:14:01 (1787832841) 00000100:00100000:2.0:1787832843.779293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832843.779415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832843.779449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832843.779484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832843.779516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832843.779575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042176 00000100:00100000:2.0:1787832843.779605:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042176 00000100:00100000:0.0:1787832843.780523:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041920 00000100:00100000:0.0:1787832843.780530:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041920 00000100:00100000:3.0:1787832843.780600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041792 00000100:00100000:3.0:1787832843.780604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041792 00000100:00100000:3.0:1787832843.780643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:3.0:1787832843.780655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2353:x1874678283042176:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832843.780820:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2353:x1874678283042176:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 167us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832843.780841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:3.0:1787832843.780871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:3.0:1787832843.780879:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2353:x1874678283041792:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832843.780917:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2353:x1874678283041792:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 39us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832843.780924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:0.0:1787832843.783358:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042048 00000100:00100000:0.0:1787832843.783376:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042048 00000100:00100000:0.0:1787832843.783549:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1787832843.783559:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283041920:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832843.783820:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787832843.783828:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283042048:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832843.783953:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b809a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283042048:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 126us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832843.783960:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00080000:3.0:1787832843.784011:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787832843.784015:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787832843.784017:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832843.784099:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283041920:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 540us (4689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832843.784125:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1787832843.784301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283041664 00000100:00100000:1.0:1787832843.784309:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283041664 00000100:00100000:1.0:1787832843.784369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 298 00000100:00100000:1.0:1787832843.784377:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283041664:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832843.786575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283041664:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2183us (7287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832843.786592:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 298 00010000:00010000:2.0:1787832843.986977:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832844.367437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832844.367756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042432 00000100:00100000:3.0:1787832844.367769:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042432 00000100:00100000:3.0:1787832844.367854:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:3.0:1787832844.367866:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:11300:x1874678283042432:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832844.367895:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832844.367923:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7569 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706918 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368026:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368064:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368078:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368098:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368106:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368112:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368871:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b757e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368885:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b757e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.368894:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b757e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832844.368905:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787832844.369127:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.369146:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.369154:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.369168:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832844.369174:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.369183:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.369197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3547ea9d00) 00010000:00010000:3.0:1787832844.370135:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832844.370153:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370162:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7570 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370184:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370190:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370197:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370308:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832844.370312:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370318:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370412:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c3543a9c400) 00010000:00010000:3.0:1787832844.370414:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832844.370418:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.370424:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7577 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.371292:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7569 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706918 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.371315:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b757e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706918 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832844.371324:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:3.0:1787832844.371327:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832844.371330:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832844.371436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:11300:x1874678283042432:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3571us (4014us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787832844.371448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 137 00000100:00100000:2.0:1787832844.379312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832844.379366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832844.379447:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042560 00000100:00100000:3.0:1787832844.379460:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042560 00000100:00100000:3.0:1787832844.379539:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 138 00000100:00100000:3.0:1787832844.379555:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:11300:x1874678283042560:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787832844.379586:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042688 00000100:00100000:1.0:1787832844.379592:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042688 00000100:00100000:1.0:1787832844.379669:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787832844.379679:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:2354:x1874678283042688:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832844.379695:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787832844.379751:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:11300:x1874678283042560:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 198us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832844.379763:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 138 00010000:00010000:1.0:1787832844.379763:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b757e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706918 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832844.379792:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:1.0:1787832844.379799:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832844.379824:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2354:x1874678283042688:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832844.379832:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00010000:00010000:0.0:1787832845.003965:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787832845.157485:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:0.0:1787832845.203669:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787832845.203683:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787832845.210882:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787832845.210898:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787832846.029001:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832846.099599:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787832846.099633:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300875136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832846.100594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832846.101062:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875136 00000100:00100000:0.0:1787832846.101075:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875136 00000100:00100000:0.0:1787832846.101172:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787832846.101184:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300875136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787832846.101234:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832846.101320:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300875136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832846.101328:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787832846.101530:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832846.101949:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560352d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300875136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832846.289007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.289295:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283042816 00000100:00100000:2.0:1787832846.289307:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283042816 00000100:00100000:2.0:1787832846.289426:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00100000:2.0:1787832846.289437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:11342:x1874678283042816:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832846.289461:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832846.289485:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b758c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70691f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289564:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289579:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289589:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289601:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289605:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289609:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289967:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289974:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289978:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289982:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832846.289986:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.289992:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290003:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832846.290005:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832846.290010:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290014:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290023:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290026:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290031:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290038:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832846.290040:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290043:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290047:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c3547ea9100) 00010000:00010000:2.0:1787832846.290049:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832846.290050:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290053:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b759a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290083:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b758c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70691f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290092:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832846.290094:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832846.290096:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b758c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70691f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.290121:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c800, rc 0) 00000100:00100000:2.0:1787832846.290189:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:11342:x1874678283042816:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 755us (1205us total) trans 0 rc 301/301 00000100:00100000:2.0:1787832846.290198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 139 00000100:00080000:3.0:1787832846.290287:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832846.296882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.297024:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043072 00000100:00100000:3.0:1787832846.297038:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043072 00000100:00100000:3.0:1787832846.297128:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 140 00000100:00100000:3.0:1787832846.297140:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:11342:x1874678283043072:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:3.0:1787832846.297243:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832846.297281:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b6f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706758 expref: 13 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.297306:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832846.297324:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832846.298059:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.298084:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.298093:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.298150:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.298169:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 5 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.298205:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35603512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300875264:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832846.298521:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832846.310816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.311148:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043200 00000100:00100000:2.0:1787832846.311162:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043200 00010000:00010000:2.0:1787832846.311253:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 6 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832846.311312:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:2.0:1787832846.311325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2353:x1874678283043200:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832846.311348:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832846.311356:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 6 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.311372:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 6 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.311401:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832846.311408:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.311418:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.311427:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.311452:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832846.311527:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2353:x1874678283043200:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 204us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832846.311536:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00010000:00010000:3.0:1787832846.311817:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706911 expref: 5 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.311840:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35603512c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300875264:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832846.311930:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.311941:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.311947:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.311976:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.311996:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.312006:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787832846.313478:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787832846.318550:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787832846.318582:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318596:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318621:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318628:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.318633:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318641:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318663:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832846.318667:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832846.318673:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.318680:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b75a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832846.319315:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042ee6d4b reply state 00000000480962b8 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.319328:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832846.319480:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:11342:x1874678283043072:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 22334us (22608us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787832846.319491:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 140 00010000:00010000:3.0:1787832846.324607:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.324630:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.324665:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.324673:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.324944:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.324958:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.324982:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c3543a9c400) 00010000:00010000:3.0:1787832846.324986:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832846.324993:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.325002:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b75a8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832846.506905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.507152:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043328 00000100:00100000:2.0:1787832846.507234:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043328 00000100:00100000:2.0:1787832846.507402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:2.0:1787832846.507416:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:11350:x1874678283043328:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:2.0:1787832846.507452:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832846.507484:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b75af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706926 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507571:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507589:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507603:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832846.507687:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787832846.507691:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832846.507784:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507816:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b75af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706926 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507836:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706926 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.507846:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:2.0:1787832846.507849:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832846.507853:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74c400, rc 0) 00000100:00100000:2.0:1787832846.507948:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:11350:x1874678283043328:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 536us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832846.507955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 141 00000100:00100000:0.0:1787832846.585517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.585642:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043456 00000100:00100000:2.0:1787832846.585655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043456 00000100:00100000:2.0:1787832846.585814:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:2.0:1787832846.585826:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b89bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:11356:x1874678283043456:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787832846.585863:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832846.585890:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b75bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70692d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.585969:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.585986:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.585999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586015:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586023:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586029:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586214:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586220:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832846.586259:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787832846.586263:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832846.586288:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586300:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586308:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586315:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586322:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832846.586327:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586337:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586351:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:2.0:1787832846.586354:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832846.586360:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b75c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586393:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586399:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586405:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586410:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832846.586413:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586420:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586427:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c3547ea9500) 00010000:00010000:2.0:1787832846.586430:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832846.586433:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586439:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b75cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586471:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b75bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70692d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586486:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70692d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.586499:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832846.586502:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787832846.586505:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74dc00, rc 0) 00000100:00100000:2.0:1787832846.586660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b89bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:11356:x1874678283043456:12345-192.168.201.34@tcp:101:bash.0 Request processed in 836us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832846.586668:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 142 00000100:00100000:0.0:1787832846.589460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.589566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043712 00000100:00100000:1.0:1787832846.589578:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043712 00000100:00100000:1.0:1787832846.589646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 143 00000100:00100000:1.0:1787832846.589657:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+15:11356:x1874678283043712:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832846.589684:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832846.589747:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b75d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706934 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.589988:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.590007:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.590022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.590222:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.590247:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.590258:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787832846.593032:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787832846.593253:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593408:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593422:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593465:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593471:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593477:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593483:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832846.593487:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593507:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593520:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832846.593523:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832846.593528:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593535:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b75e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787832846.593550:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010146642 reply state 00000000eaa9c9e1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832846.593560:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787832846.593683:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b75d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.593698:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.594010:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:1.0:1787832846.594012:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832846.594015:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41400, rc 0) 00000100:00100000:1.0:1787832846.594148:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11356:x1874678283043712:12345-192.168.201.34@tcp:101:bash.0 Request processed in 4491us (4700us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787832846.594157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 143 00010000:00010000:1.0:1787832846.602456:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602494:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602503:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602509:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832846.602515:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602523:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602541:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543c5a800) 00010000:00010000:1.0:1787832846.602545:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832846.602550:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.602556:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b75e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.604363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560c80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300875392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832846.604467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832846.604567:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300875904:0@lo:400:kworker.0 00000100:00100000:3.0:1787832846.604600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832846.604628:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832846.604634:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300875520:0@lo:400:kworker.0 00000100:00100000:3.0:1787832846.604665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832846.604840:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875904 00000100:00100000:1.0:1787832846.604852:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875904 00000100:00100000:0.0:1787832846.604858:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875392 00000100:00100000:0.0:1787832846.604867:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875392 00000100:00100000:0.0:1787832846.604955:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787832846.604959:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787832846.604971:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35603512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300875392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832846.604979:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300875904:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787832846.605024:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832846.605111:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300875904:12345-0@lo:400:kworker.0 Request processed in 140us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832846.605120:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787832846.605172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875520 00000100:00100000:2.0:1787832846.605178:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875520 00000100:00100000:1.0:1787832846.605183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300875776:0@lo:400:kworker.0 00000100:00100000:2.0:1787832846.605226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787832846.605238:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300875520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832846.605252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832846.605305:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832846.605324:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3558b66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300875648:0@lo:400:kworker.0 00000100:00100000:1.0:1787832846.605366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832846.605373:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300875904:0@lo:400:kworker.0 00000100:00100000:1.0:1787832846.605425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875776 00000100:00100000:1.0:1787832846.605433:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875776 00000100:00100000:3.0:1787832846.605449:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300875648 00000100:00100000:3.0:1787832846.605467:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300875648 00000100:00100000:1.0:1787832846.605480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787832846.605495:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300875776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832846.605512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787832846.605524:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832846.605561:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300875776:12345-0@lo:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832846.605572:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787832846.605592:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300875648:12345-0@lo:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.605603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787832846.605626:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300875648:0@lo:400:kworker.0 00000100:00100000:1.0:1787832846.605653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3558b64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300875776:0@lo:400:kworker.0 00000100:00080000:1.0:1787832846.605694:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787832846.605748:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832846.606587:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35603512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300875392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1615us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832846.606611:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787832846.607064:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300875520:12345-0@lo:400:kworker.0 Request processed in 1828us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832846.607075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787832846.609600:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300875520:0@lo:400:kworker.0 00000100:00100000:3.0:1787832846.609632:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560c80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300875392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832846.609858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.610210:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043840 00000100:00100000:3.0:1787832846.610217:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043840 00000100:00100000:3.0:1787832846.610301:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00080000:1.0:1787832846.610479:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832846.610511:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283043840:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832846.610527:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832846.610546:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70693b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832846.610571:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832846.610588:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1787832846.610592:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832846.610601:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.610619:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.610632:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832846.610854:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560c80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283043840:12345-192.168.201.34@tcp:101:bash.0 Request processed in 544us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.610862:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1787832846.615051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.615162:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283043968 00000100:00100000:3.0:1787832846.615171:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283043968 00000100:00100000:3.0:1787832846.615228:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787832846.615239:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:11356:x1874678283043968:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832846.615256:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832846.615287:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.615329:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.615339:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832846.615343:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832846.615349:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.615383:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.615397:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 7 pid: 6695 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.615412:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560350780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300876032:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832846.615509:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787832846.621590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.623080:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283044096 00000100:00100000:1.0:1787832846.623093:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283044096 00010000:00010000:1.0:1787832846.623157:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 8 pid: 6695 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832846.623205:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1787832846.623214:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283044096:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832846.623230:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832846.623257:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 8 pid: 6695 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.623308:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 8 pid: 6695 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.623333:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832846.623339:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832846.623347:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.623357:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.623396:0:8455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832846.623410:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb76940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8455:1874678300876160:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787832846.623514:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f05000 going to sleep for 11 seconds 00010000:00010000:3.0:1787832846.629119:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b75fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70693b expref: 8 pid: 6695 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.629150:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560350780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300876032:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832846.629186:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.629202:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832846.629291:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:11356:x1874678283043968:12345-192.168.201.34@tcp:101:bash.0 Request processed in 14053us (14249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.630614:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787832846.632071:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb76940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8455:1874678300876160:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787832846.632106:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832846.632173:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283044096:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 8958us (10591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.632185:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1787832846.637541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.637992:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283044352 00000100:00100000:3.0:1787832846.638003:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283044352 00000100:00100000:3.0:1787832846.638064:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:3.0:1787832846.638075:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11356:x1874678283044352:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787832846.638471:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11356:x1874678283044352:12345-192.168.201.34@tcp:35:bash.0 Request processed in 396us (938us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787832846.638478:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:2.0:1787832846.718876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.718981:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283044608 00000100:00100000:1.0:1787832846.718991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283044608 00000100:00100000:1.0:1787832846.719053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:1.0:1787832846.719063:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11366:x1874678283044608:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832846.719088:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832846.719138:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b760a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706949 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832846.719278:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787832846.719426:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b760a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706949 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.719442:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:1.0:1787832846.719446:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832846.719452:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b760a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706949 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.719468:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832846.719545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11366:x1874678283044608:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 483us (680us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787832846.719553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 144 00000100:00100000:2.0:1787832846.722282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.722379:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283044864 00000100:00100000:3.0:1787832846.722402:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283044864 00000100:00100000:3.0:1787832846.722459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1787832846.722469:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11366:x1874678283044864:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832846.722758:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11366:x1874678283044864:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 288us (483us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787832846.722766:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:0.0:1787832846.797053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.797152:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283044992 00000100:00100000:3.0:1787832846.797172:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283044992 00000100:00100000:3.0:1787832846.797242:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:3.0:1787832846.797253:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11372:x1874678283044992:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832846.797279:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832846.797313:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706950 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797385:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797400:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797413:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832846.797481:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787832846.797486:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832846.797511:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797538:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706950 expref: 22 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797573:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706950 expref: 21 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.797582:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832846.797585:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832846.797588:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832846.797653:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11372:x1874678283044992:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 402us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.797661:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 145 00000100:00100000:2.0:1787832846.803921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.804018:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283045248 00000100:00100000:1.0:1787832846.804028:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283045248 00000100:00100000:1.0:1787832846.804111:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:1.0:1787832846.804122:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11372:x1874678283045248:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832846.804143:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832846.804175:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b7626 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706957 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.804281:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b762d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.804305:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b762d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.804337:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b762d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832846.804350:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787832846.804492:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b7626 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706957 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.804513:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b762d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706957 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.804522:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:1.0:1787832846.804524:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832846.804527:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40600, rc 0) 00000100:00100000:1.0:1787832846.804597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11372:x1874678283045248:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 476us (687us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787832846.804605:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 146 00000100:00100000:0.0:1787832846.811207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.811309:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283045504 00000100:00100000:3.0:1787832846.811321:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283045504 00000100:00100000:3.0:1787832846.811389:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:3.0:1787832846.811402:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11372:x1874678283045504:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832846.811426:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832846.811446:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b763b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70695e expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.811555:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.811571:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.811582:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832846.811595:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787832846.811880:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b763b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70695e expref: 26 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.811898:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70695e expref: 25 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.811906:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:3.0:1787832846.811909:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787832846.811913:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832846.812024:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:11372:x1874678283045504:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 624us (828us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787832846.812032:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 147 00000100:00100000:2.0:1787832846.824738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.826194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283045632 00000100:00100000:1.0:1787832846.826209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283045632 00000100:00100000:1.0:1787832846.826293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:1.0:1787832846.826305:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:2353:x1874678283045632:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832846.826322:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832846.826355:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b762d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706957 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.826376:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:1.0:1787832846.826382:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832846.826463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:2353:x1874678283045632:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 160us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832846.826471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787832846.830460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.830664:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283045760 00000100:00100000:3.0:1787832846.830673:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283045760 00000100:00100000:0.0:1787832846.830956:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787832846.830968:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678283045760:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1787832846.831011:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.831033:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.831041:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832846.831045:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832846.831049:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.831085:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 6 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.831117:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 6 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832846.831151:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1874678300876288:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832846.831383:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66540 going to sleep for 11 seconds 00000100:00100000:0.0:1787832846.834652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.834834:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283045888 00000100:00100000:3.0:1787832846.834844:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283045888 00002000:00100000:3.0:1787832846.834892:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c3546495e00 x1874678283045888/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:407/0 lens 504/0 e 0 to 0 dl 1787832857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832846.834904:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3546495e00 with x1874678283045888 ext(0->12) 00010000:00010000:3.0:1787832846.834912:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 7 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.834928:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 7 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832846.834936:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3546495e00 00000100:00100000:3.0:1787832846.834962:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787832846.834972:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283045888:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:3.0:1787832846.835447:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546495e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283045888:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 475us (803us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787832846.835456:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00002000:00100000:3.0:1787832846.835463:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c3546495e00 x1874678283045888/t4294967305(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:407/0 lens 504/448 e 0 to 0 dl 1787832857 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832846.835472:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3546495e00 with x1874678283045888 ext(0->12) 00010000:00010000:3.0:1787832846.835478:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.835489:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832846.835497:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3546495e00 00000100:00100000:2.0:1787832846.837183:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1874678300876288:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832846.837211:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.839922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832846.840053:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283046016 00000100:00100000:0.0:1787832846.840062:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283046016 00010000:00010000:0.0:1787832846.840112:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832846.840151:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:0.0:1787832846.840168:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283046016:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832846.840182:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787832846.840202:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787832846.840205:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787832847 00002000:00010000:0.0:1787832846.840207:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787832847 00002000:00010000:0.0:1787832846.840210:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787832847 00010000:00010000:0.0:1787832846.840216:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.840230:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.840251:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903e1b83/0x72bd9178b14b7603 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706942 expref: 9 pid: 8408 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.840285:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832846.840290:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832846.840295:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.840314:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.840345:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832846.840402:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283046016:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 242us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832846.840409:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:2.0:1787832846.840750:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840760:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840795:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840803:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840812:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840819:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832846.840823:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840831:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840845:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.840852:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b7650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832846.840913:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283045760:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 9948us (10462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832846.840921:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:3.0:1787832846.845996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.846511:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283046272 00000100:00100000:2.0:1787832846.846522:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283046272 00000100:00100000:2.0:1787832846.846634:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1787832846.846646:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11372:x1874678283046272:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:1.0:1787832846.847569:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70695e expref: 24 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787832846.848028:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787832846.848079:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787832846.852511:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787832846.852615:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.852637:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.852647:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.852688:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.852728:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 28 pid: 5844 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832846.852757:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3546494b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300876416:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832846.852908:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66540 going to sleep for 11 seconds 00000100:00100000:0.0:1787832846.856828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.857496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283046400 00000100:00100000:1.0:1787832846.857506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283046400 00010000:00010000:1.0:1787832846.857551:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 29 pid: 5844 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832846.857596:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787832846.857607:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357383a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:2352:x1874678283046400:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832846.857622:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832846.857629:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 29 pid: 5844 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.857643:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 29 pid: 5844 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.857666:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:1.0:1787832846.857672:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.857681:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.857752:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832846.857773:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832846.857831:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357383a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:2352:x1874678283046400:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 225us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832846.857839:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00010000:00010000:3.0:1787832846.859946:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b75ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706934 expref: 28 pid: 5844 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.859968:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3546494b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1874678300876416:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832846.859989:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.859999:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.860005:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832846.860147:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787832846.860462:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787832846.860569:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300876544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787832846.860637:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832846.860677:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832846.860833:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300876544 00000100:00100000:1.0:1787832846.860839:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300876544 00000100:00100000:1.0:1787832846.860923:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787832846.860932:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300876544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787832846.860994:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300876544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832846.861001:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787832846.861084:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300876544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787832846.861481:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787832846.861529:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300876672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787832846.861556:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832846.861907:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832846.861933:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300876672 00000100:00100000:0.0:1787832846.861938:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300876672 00000100:00100000:0.0:1787832846.861964:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787832846.861970:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874678300876672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787832846.862146:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874678300876672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (587us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787832846.862153:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787832846.862284:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1874678300876672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787832846.862388:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787832846.862421:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862431:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862439:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862445:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.862450:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862458:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862488:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:3.0:1787832846.862491:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787832846.862497:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.862504:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7657 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832846.862659:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787832846.862851:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787832846.862862:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369891158674ns, next at 370891156904ns, rc = 0 00000001:00080000:3.0:1787832846.862868:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787832846.862895:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a500) 00010000:00010000:3.0:1787832846.862898:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787832846.862905:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70695e expref: 32 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.863042:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:11372:x1874678283046272:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 16398us (17058us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787832846.863051:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000020:00080000:3.0:1787832846.863055:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787832846.866613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832846.866814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283046528 00000100:00100000:1.0:1787832846.866824:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283046528 00000100:00100000:0.0:1787832846.866983:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:0.0:1787832846.866993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:11372:x1874678283046528:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832846.867017:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832846.867042:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b765e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706965 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.867119:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b765e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706965 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.867134:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b765e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706965 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832846.867154:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:0.0:1787832846.867181:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787832846.867185:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832846.867246:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11372:x1874678283046528:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 255us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832846.867253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 148 00000100:00100000:1.0:1787832846.870776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832846.870883:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283046784 00000100:00100000:0.0:1787832846.870892:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283046784 00000100:00100000:0.0:1787832846.870946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787832846.870955:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11372:x1874678283046784:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787832846.871199:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:11372:x1874678283046784:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 244us (431us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787832846.871207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:1.0:1787832846.983428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832846.983578:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283047040 00000100:00100000:2.0:1787832846.983590:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283047040 00000100:00100000:2.0:1787832846.983656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:2.0:1787832846.983667:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+33:11382:x1874678283047040:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832846.983727:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832846.983752:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b7665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70696c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832846.983870:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787832846.983996:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b7665 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70696c expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.984012:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:2.0:1787832846.984016:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832846.984021:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b7665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70696c expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832846.984036:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c354b74d800, rc 0) 00000100:00100000:2.0:1787832846.984114:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11382:x1874678283047040:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 450us (699us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787832846.984122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 149 00000100:00100000:1.0:1787832846.995815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832846.995909:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283047168 00000100:00100000:3.0:1787832846.995920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283047168 00000100:00100000:3.0:1787832846.995986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:3.0:1787832846.995996:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11382:x1874678283047168:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1787832846.996075:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996123:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996139:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996156:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996163:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996170:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996273:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996280:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996288:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832846.996345:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996358:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996364:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996381:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996386:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.996390:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996397:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996409:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832846.996412:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832846.996415:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996422:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996435:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996441:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996446:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996451:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.996455:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996470:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996479:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543a9c800) 00010000:00010000:3.0:1787832846.996481:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832846.996484:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996489:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b767a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996504:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996510:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996515:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996519:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832846.996522:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996527:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996533:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832846.996535:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832846.996538:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832846.996553:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832846.996643:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11382:x1874678283047168:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 647us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832846.996652:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 150 00000100:00100000:1.0:1787832847.012045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832847.012175:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283047424 00000100:00100000:0.0:1787832847.012189:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283047424 00000100:00100000:0.0:1787832847.012267:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1787832847.012279:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11382:x1874678283047424:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:0.0:1787832847.012600:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:11382:x1874678283047424:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 323us (567us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787832847.012608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00010000:00010000:2.0:1787832847.052494:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832847.099976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.100078:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283047680 00000100:00100000:2.0:1787832847.100112:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283047680 00000100:00100000:2.0:1787832847.100183:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:2.0:1787832847.100194:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:11385:x1874678283047680:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832847.100219:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832847.100242:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b7688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706973 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100324:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100339:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100352:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100373:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100379:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100521:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100530:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100538:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832847.100553:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787832847.100665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100674:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100681:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100944:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832847.100949:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100956:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100969:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832847.100972:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832847.100976:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100982:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c800/0x72bd9178b14b768f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.100996:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101003:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101019:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101024:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832847.101027:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101034:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101041:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9500) 00010000:00010000:2.0:1787832847.101044:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832847.101046:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101052:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d600/0x72bd9178b14b7696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101105:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d800/0x72bd9178b14b7688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101120:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.101128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832847.101130:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832847.101133:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610aa00, rc 0) 00000100:00100000:2.0:1787832847.101248:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11385:x1874678283047680:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1056us (1282us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787832847.101268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 151 00000100:00100000:0.0:1787832847.113945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832847.116263:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283047808 00000100:00100000:3.0:1787832847.116279:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283047808 00000100:00100000:3.0:1787832847.116403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:3.0:1787832847.116414:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11385:x1874678283047808:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:3.0:1787832847.116482:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116501:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116513:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116539:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116547:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116554:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116561:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832847.116565:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116586:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116614:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832847.116617:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832847.116622:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.116629:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832847.116806:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11385:x1874678283047808:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 393us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832847.116815:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 152 00000100:00100000:0.0:1787832847.120414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.120536:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283048064 00000100:00100000:2.0:1787832847.120546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283048064 00000100:00100000:2.0:1787832847.120644:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:2.0:1787832847.120655:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11385:x1874678283048064:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832847.120960:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:11385:x1874678283048064:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 306us (556us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787832847.120968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:1.0:1787832847.451070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.451539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283048320 00000100:00100000:2.0:1787832847.451549:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283048320 00000100:00100000:2.0:1787832847.451617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:2.0:1787832847.451628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:11416:x1874678283048320:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1787832847.451654:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832847.451675:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b76b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70697a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.451894:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.451910:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.451923:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832847.451934:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787832847.452068:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b76b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70697a expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.452116:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70697a expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.452124:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832847.452127:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832847.452130:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a400, rc 0) 00000100:00100000:2.0:1787832847.452267:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11416:x1874678283048320:12345-192.168.201.34@tcp:101:cat.0 Request processed in 641us (1207us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787832847.452274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 153 00000100:00100000:0.0:1787832847.458667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832847.459277:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283048576 00000100:00100000:3.0:1787832847.459299:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283048576 00000100:00100000:3.0:1787832847.459359:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:3.0:1787832847.459369:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11416:x1874678283048576:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:3.0:1787832847.459634:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:11416:x1874678283048576:12345-192.168.201.34@tcp:35:cat.0 Request processed in 266us (977us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787832847.459643:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:0.0:1787832847.469932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.470029:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283048704 00000100:00100000:2.0:1787832847.470040:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283048704 00000100:00100000:2.0:1787832847.470121:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832847.470132:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:2353:x1874678283048704:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832847.470149:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832847.470186:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70697a expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.470208:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832847.470215:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832847.470453:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:2353:x1874678283048704:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 321us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832847.470461:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832847.540971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832847.541185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283048960 00000100:00100000:0.0:1787832847.541196:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283048960 00000100:00100000:0.0:1787832847.541261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:0.0:1787832847.541271:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11422:x1874678283048960:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:0.0:1787832847.541322:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832847.541325:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787832847.541352:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b761f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706950 expref: 40 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541369:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832847.541374:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832847.541386:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b76c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706981 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541505:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541519:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541527:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541559:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.541572:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 40 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832847.541583:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2acf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300876800:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832847.541670:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66780 going to sleep for 11 seconds 00000100:00100000:0.0:1787832847.548543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832847.548675:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2acf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300876800:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832847.548755:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832847.549009:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283049088 00000100:00100000:3.0:1787832847.549016:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283049088 00010000:00010000:3.0:1787832847.549055:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 41 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832847.549105:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1787832847.549116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+41:2352:x1874678283049088:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832847.549139:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832847.549146:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 41 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549158:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 41 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549180:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b769d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706973 expref: 41 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549197:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832847.549202:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549212:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549220:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.549249:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832847.549317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:2352:x1874678283049088:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 203us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832847.549325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00010000:00010000:1.0:1787832847.549428:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832847.549437:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832847.549455:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787832847.549618:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b76c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832847.549636:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832847.549643:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:1.0:1787832847.549646:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832847.549649:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:1.0:1787832847.549677:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cf64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11422:x1874678283048960:12345-192.168.201.34@tcp:101:dd.0 Request processed in 8408us (8718us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787832847.549685:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 154 00000100:00100000:1.0:1787832847.553671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.553912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283049344 00000100:00100000:2.0:1787832847.553922:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283049344 00000100:00100000:2.0:1787832847.553983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 155 00000100:00100000:2.0:1787832847.554010:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11422:x1874678283049344:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1787832847.554404:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.554423:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.554434:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832847.554483:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787832847.554508:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2680fa reply state 000000007b24cc85 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832847.554517:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832847.554862:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:11422:x1874678283049344:12345-192.168.201.34@tcp:36:dd.0 Request processed in 851us (1197us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787832847.554869:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 155 00000020:00080000:2.0:1787832847.554874:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787832847.566889:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566909:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566917:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566922:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832847.566928:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566956:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566973:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832847.566976:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832847.566982:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.566987:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a400/0x72bd9178b14b76dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787832847.713621:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787832847.713639:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1787832847.884131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832847.884456:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283049472 00000100:00100000:3.0:1787832847.884467:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283049472 00000100:00100000:3.0:1787832847.884536:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:3.0:1787832847.884546:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+42:11436:x1874678283049472:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:3.0:1787832847.884595:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832847.884620:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706988 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885322:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885340:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885353:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885370:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885377:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885383:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885491:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885504:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885512:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885548:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832847.885574:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 43 pid: 5844 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832847.885589:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560353840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300876928:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832847.886306:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787832847.891016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832847.891137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283049728 00000100:00100000:1.0:1787832847.891158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283049728 00000100:00100000:1.0:1787832847.891221:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:1.0:1787832847.891232:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+44:6057:x1874678283049728:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787832847.892400:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:6057:x1874678283049728:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 1164us (1390us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787832847.892409:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1787832847.893425:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560353840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300876928:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832847.893455:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832847.896238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832847.896350:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283049856 00000100:00100000:2.0:1787832847.896361:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283049856 00010000:00010000:2.0:1787832847.896405:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 45 pid: 5844 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832847.896447:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1787832847.896456:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:2353:x1874678283049856:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832847.896472:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832847.896479:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 45 pid: 5844 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896492:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 45 pid: 5844 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896518:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b76ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706981 expref: 45 pid: 5844 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896555:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832847.896561:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896569:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896578:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832847.896614:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832847.897016:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+44:2353:x1874678283049856:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 558us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832847.897025:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00010000:00010000:0.0:1787832847.897162:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897172:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832847.897216:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787832847.897221:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832847.897245:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897282:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897288:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897296:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897302:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832847.897307:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897315:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897325:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832847.897337:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832847.897342:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897348:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b76ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897361:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897367:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897373:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897378:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832847.897381:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897387:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543a9c400) 00010000:00010000:0.0:1787832847.897397:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832847.897399:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897404:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b76f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897438:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706988 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897464:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706988 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832847.897472:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:0.0:1787832847.897474:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832847.897476:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:0.0:1787832847.897509:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:11436:x1874678283049472:12345-192.168.201.34@tcp:101:stat.0 Request processed in 12965us (13389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832847.897517:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 156 00000100:00100000:0.0:1787832848.007484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832848.008967:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283050112 00000100:00100000:3.0:1787832848.008982:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283050112 00000100:00100000:3.0:1787832848.009084:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 157 00000100:00100000:3.0:1787832848.009097:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:11442:x1874678283050112:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:3.0:1787832848.009171:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832848.009206:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b76f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706988 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.009227:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832848.009234:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787832848.010000:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787832848.010211:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.010230:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.010242:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832848.010404:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787832848.010432:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c162f206 reply state 000000007f66674e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832848.010441:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832848.010567:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:11442:x1874678283050112:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 1470us (3091us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787832848.010578:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 157 00000020:00080000:3.0:1787832848.010584:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787832848.018513:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018532:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018540:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018546:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832848.018551:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018559:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018607:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832848.018610:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832848.018615:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.018622:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b76ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.076295:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832848.379574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.380215:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283050240 00000100:00100000:1.0:1787832848.380225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283050240 00000100:00100000:1.0:1787832848.380303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:1.0:1787832848.380315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+44:11456:x1874678283050240:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:1.0:1787832848.380341:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832848.380362:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70698f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.380573:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381238:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381255:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381342:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381350:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381357:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381477:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381486:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381494:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832848.381533:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787832848.381537:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832848.381560:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381572:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381581:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381586:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381593:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381599:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832848.381603:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381610:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.381630:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832848.382507:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832848.382516:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382525:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b770d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382546:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382553:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382560:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382565:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832848.382569:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382575:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382586:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543c5a800) 00010000:00010000:1.0:1787832848.382589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832848.382592:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.382674:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.383463:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.383477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:1.0:1787832848.383479:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832848.383482:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832848.383581:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:11456:x1874678283050240:12345-192.168.201.34@tcp:101:stat.0 Request processed in 3264us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832848.383589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 158 00000100:00100000:1.0:1787832848.603473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.603587:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283050496 00000100:00100000:2.0:1787832848.603597:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283050496 00000100:00100000:2.0:1787832848.603661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:2.0:1787832848.603671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+45:11466:x1874678283050496:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832848.603747:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832848.603770:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706996 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832848.603900:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787832848.604040:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7722 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706996 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.604056:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:2.0:1787832848.604060:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832848.604077:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706996 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.604092:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610b400, rc 0) 00000100:00100000:2.0:1787832848.604165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+46:11466:x1874678283050496:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 495us (702us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787832848.604190:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 159 00000100:00100000:2.0:1787832848.614179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.614473:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283050752 00000100:00100000:1.0:1787832848.614485:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283050752 00000100:00100000:1.0:1787832848.614556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:1.0:1787832848.614567:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+46:11466:x1874678283050752:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787832848.615137:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:11466:x1874678283050752:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 563us (961us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787832848.615146:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1787832848.762248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832848.762359:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051008 00000100:00100000:3.0:1787832848.762370:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051008 00000100:00100000:3.0:1787832848.762436:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:3.0:1787832848.762446:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:11472:x1874678283051008:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832848.762474:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832848.762496:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7730 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b70699d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.762622:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.762638:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.762648:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.762686:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.762763:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 48 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832848.762778:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3560353840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300877056:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832848.762889:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787832848.769243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.769410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051136 00000100:00100000:1.0:1787832848.769419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051136 00010000:00010000:1.0:1787832848.769463:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 49 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832848.769510:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1787832848.769537:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:2352:x1874678283051136:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832848.769554:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832848.769563:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 49 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.769577:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 49 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.769602:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:1.0:1787832848.769608:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.769618:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.769627:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.769656:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832848.769775:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+49:2352:x1874678283051136:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 241us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832848.769783:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00010000:00010000:3.0:1787832848.771016:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b771b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70698f expref: 48 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832848.771039:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3560353840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874678300877056:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832848.771076:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.771085:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.771091:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832848.771113:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787832848.771358:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7730 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.771375:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.771383:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832848.771398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787832848.771403:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832848.771520:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+48:11472:x1874678283051008:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9075us (9281us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787832848.771529:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 160 00000100:00100000:0.0:1787832848.778040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.778289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051392 00000100:00100000:2.0:1787832848.778300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051392 00000100:00100000:2.0:1787832848.778355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 161 00000100:00100000:2.0:1787832848.778366:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+48:11472:x1874678283051392:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1787832848.778659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.778677:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.778729:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832848.778927:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787832848.779033:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ae00e74 reply state 0000000010f9cc14 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832848.779042:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832848.779552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11472:x1874678283051392:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1184us (1521us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787832848.779561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 161 00000020:00080000:2.0:1787832848.779567:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787832848.787585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.787681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051520 00000100:00100000:1.0:1787832848.787699:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051520 00000100:00100000:1.0:1787832848.787788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:1.0:1787832848.787798:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11472:x1874678283051520:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832848.787824:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832848.787846:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b774c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069a4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788141:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788158:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788167:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788174:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788194:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788219:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.788234:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 52 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832848.788247:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b38f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300877184:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832848.788343:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f05480 going to sleep for 11 seconds 00000100:00100000:2.0:1787832848.791376:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b38f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300877184:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832848.791409:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832848.792991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832848.793153:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051648 00000100:00100000:3.0:1787832848.793163:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051648 00010000:00010000:3.0:1787832848.793204:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 53 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832848.793244:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1787832848.793254:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:2353:x1874678283051648:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832848.793275:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832848.793282:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 53 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793296:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 53 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793319:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b70699d expref: 53 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793336:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832848.793341:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793349:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793374:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.793381:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832848.793446:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:2353:x1874678283051648:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 193us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832848.793454:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00010000:00010000:0.0:1787832848.795565:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795581:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795588:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795593:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832848.795598:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795625:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795642:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:0.0:1787832848.795645:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832848.795648:0:3291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795657:0:3291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832848.795664:0:3291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.796568:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832848.796580:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.796644:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.796652:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832848.797025:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787832848.797030:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832848.797054:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.797106:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b774c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069a4 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.797411:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069a4 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.797422:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832848.797424:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832848.797428:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40600, rc 0) 00000100:00100000:2.0:1787832848.797541:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b809e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:11472:x1874678283051520:12345-192.168.201.34@tcp:101:bash.0 Request processed in 9743us (9967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832848.797551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 162 00000100:00100000:2.0:1787832848.804404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.804502:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283051904 00000100:00100000:1.0:1787832848.804512:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283051904 00000100:00100000:1.0:1787832848.805114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787832848.805128:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:11472:x1874678283051904:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1787832848.805386:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11472:x1874678283051904:12345-192.168.201.34@tcp:35:bash.0 Request processed in 261us (993us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787832848.805394:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:1.0:1787832848.914995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.915183:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052032 00000100:00100000:2.0:1787832848.915194:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052032 00000100:00100000:2.0:1787832848.915258:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00100000:2.0:1787832848.915294:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283052032:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832848.915376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283052032:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832848.915383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 300 00000100:00100000:3.0:1787832848.927342:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832848.927445:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052160 00000100:00100000:0.0:1787832848.927456:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052160 00000100:00100000:0.0:1787832848.927538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1787832848.927549:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678283052160:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832848.927643:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560353840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2355:x1874678283052160:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832848.927650:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00080000:1.0:1787832848.927722:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832848.933582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832848.933632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.933739:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052288 00000100:00100000:2.0:1787832848.933752:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052288 00000100:00100000:3.0:1787832848.933890:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052416 00000100:00100000:3.0:1787832848.933895:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052416 00000100:00100000:3.0:1787832848.933951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:3.0:1787832848.933962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283052416:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832848.934036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2352:x1874678283052416:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832848.934045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:2.0:1787832848.934678:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832848.934744:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283052288:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832848.934787:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2352:x1874678283052288:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 101us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832848.934795:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00080000:1.0:1787832848.938764:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832848.938778:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832848.959309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832848.959405:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052672 00000100:00100000:3.0:1787832848.959417:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052672 00000100:00100000:3.0:1787832848.959493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:3.0:1787832848.959505:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11483:x1874678283052672:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832848.959536:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832848.959560:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b775a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069ab expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832848.959696:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787832848.959881:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b775a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ab expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.959925:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:3.0:1787832848.959929:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832848.959934:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b775a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ab expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832848.959951:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:3.0:1787832848.960022:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11483:x1874678283052672:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 520us (725us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787832848.960031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 163 00000100:00100000:3.0:1787832848.965914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.966494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283052800 00000100:00100000:2.0:1787832848.966505:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283052800 00000100:00100000:2.0:1787832848.966571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:2.0:1787832848.966581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11483:x1874678283052800:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787832848.966662:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966681:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966744:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966761:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966768:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966789:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966913:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966921:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.966928:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832848.967594:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967608:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967614:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967620:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967626:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610be00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832848.967630:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967637:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967650:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832848.967663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832848.967670:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967676:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967693:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967698:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967738:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967744:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610bc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832848.967746:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967752:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967761:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9300) 00010000:00010000:2.0:1787832848.967763:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832848.967766:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967772:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b776f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967787:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967800:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967805:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967811:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832848.967814:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967820:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967828:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832848.967830:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832848.967833:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832848.967838:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832848.968517:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11483:x1874678283052800:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1933us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832848.968528:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 164 00000100:00100000:0.0:1787832848.974065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832848.974388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283053056 00000100:00100000:2.0:1787832848.974401:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283053056 00000100:00100000:2.0:1787832848.974471:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1787832848.974483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11483:x1874678283053056:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832848.975558:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:11483:x1874678283053056:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 1070us (1504us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787832848.975584:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:1.0:1787832849.051691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.053464:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283053312 00000100:00100000:3.0:1787832849.053479:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283053312 00000100:00100000:3.0:1787832849.053573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:3.0:1787832849.053585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+53:11486:x1874678283053312:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832849.053611:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832849.053636:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b777d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069b2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.053926:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054010:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054024:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054085:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054094:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054101:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054436:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054447:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.054454:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832849.054463:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787832849.055010:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055019:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055025:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055031:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832849.055035:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055063:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055077:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832849.055080:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832849.055085:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055091:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055105:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055112:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055247:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055326:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832849.055330:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055337:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055346:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543a9c800) 00010000:00010000:3.0:1787832849.055349:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832849.055352:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055369:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b778b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b777d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b2 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055439:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b2 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.055446:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:3.0:1787832849.055448:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832849.055451:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832849.055591:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:11486:x1874678283053312:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2007us (3909us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787832849.055600:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 165 00000100:00100000:2.0:1787832849.062333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832849.062434:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283053440 00000100:00100000:1.0:1787832849.062445:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283053440 00000100:00100000:1.0:1787832849.062526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:1.0:1787832849.062539:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:2353:x1874678283053440:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832849.062562:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832849.062594:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b2 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832849.062616:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:1.0:1787832849.062623:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832849.062959:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:2353:x1874678283053440:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 419us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832849.062989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1787832849.067422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832849.070070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283053568 00000100:00100000:2.0:1787832849.070089:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283053568 00000100:00100000:2.0:1787832849.070406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:2.0:1787832849.070419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11486:x1874678283053568:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787832849.070507:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070530:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070544:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070581:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070588:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070596:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070601:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832849.070605:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070613:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070645:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832849.070648:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832849.070654:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.070661:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832849.070812:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11486:x1874678283053568:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 394us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832849.070820:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 166 00000100:00100000:0.0:1787832849.076234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.076570:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283053824 00000100:00100000:3.0:1787832849.076584:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283053824 00000100:00100000:3.0:1787832849.076686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1787832849.076698:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11486:x1874678283053824:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832849.077419:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:11486:x1874678283053824:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 721us (1196us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787832849.077432:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00010000:00010000:3.0:1787832849.102949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832849.314885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832849.315407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054080 00000100:00100000:2.0:1787832849.315417:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054080 00000100:00100000:2.0:1787832849.315530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:2.0:1787832849.315541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:11504:x1874678283054080:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:2.0:1787832849.315565:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832849.315588:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069b9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.315685:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b77ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.315699:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b77ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.315750:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b77ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832849.315761:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787832849.315913:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b77a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b9 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.315932:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b77ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b9 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.315941:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832849.315944:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787832849.315948:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610bc00, rc 0) 00000100:00100000:2.0:1787832849.316015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11504:x1874678283054080:12345-192.168.201.34@tcp:101:cat.0 Request processed in 476us (1149us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787832849.316023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:0.0:1787832849.356304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.356440:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054208 00000100:00100000:3.0:1787832849.356450:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054208 00000100:00100000:3.0:1787832849.356515:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:3.0:1787832849.356539:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11505:x1874678283054208:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832849.356561:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832849.356579:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069c0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356645:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356656:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356665:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832849.356760:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787832849.356764:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832849.356789:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356815:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c0 expref: 59 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356833:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c0 expref: 58 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.356841:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832849.356843:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832849.356846:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832849.356910:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+58:11505:x1874678283054208:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 371us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832849.356924:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 168 00000100:00100000:0.0:1787832849.366919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832849.367028:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054592 00000100:00100000:2.0:1787832849.367038:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054592 00000100:00100000:2.0:1787832849.367115:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832849.367126:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+58:11505:x1874678283054592:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832849.367617:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11505:x1874678283054592:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 491us (706us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787832849.367625:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1787832849.371954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.372329:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054720 00000100:00100000:3.0:1787832849.372340:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054720 00000100:00100000:2.0:1787832849.372972:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832849.372987:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573838450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11505:x1874678283054720:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:2.0:1787832849.373008:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787832849.373036:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069a4 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.373072:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b77ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069b9 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.373100:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b765e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706965 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832849.373112:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1f900) 00010000:00010000:2.0:1787832849.373133:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832849.373207:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573838450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11505:x1874678283054720:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 224us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832849.373215:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832849.384663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.384860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054848 00000100:00100000:3.0:1787832849.384870:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054848 00000100:00100000:3.0:1787832849.384935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:3.0:1787832849.384946:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11505:x1874678283054848:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:3.0:1787832849.385074:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.385091:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.385104:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832849.385982:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787832849.386085:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11505:x1874678283054848:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 1138us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832849.386095:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 169 00000100:00100000:0.0:1787832849.419104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832849.419239:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283054976 00000100:00100000:3.0:1787832849.419258:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283054976 00000100:00100000:3.0:1787832849.419319:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 170 00000100:00100000:3.0:1787832849.419329:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11507:x1874678283054976:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832849.419352:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832849.419372:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b77d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069c7 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419458:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419472:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419482:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419496:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419503:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419510:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419606:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419614:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.419621:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832849.419654:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787832849.419658:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832849.419676:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420418:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420428:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420434:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420441:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420447:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832849.420451:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420458:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420470:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832849.420473:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832849.420478:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420485:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b77d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420497:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420503:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420516:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420522:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832849.420525:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420532:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420540:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543a9cd00) 00010000:00010000:3.0:1787832849.420542:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832849.420545:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420550:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b77df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420587:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b77d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 58 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420600:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 57 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832849.420607:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:3.0:1787832849.420609:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832849.420611:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87200, rc 0) 00000100:00100000:3.0:1787832849.420669:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11507:x1874678283054976:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1342us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832849.423038:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 170 00010000:00010000:2.0:1787832850.132302:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787832850.270778:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000001:00080000:2.0:1787832850.270804:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:00080000:2.0:1787832850.270828:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1787832850.270869:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787832850.270897:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c356615ed80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787832850.270902:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c355ce62600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c356615ecc0 00000020:00080000:2.0:1787832850.270905:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c355ce62500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3565b50c00 00000020:00080000:2.0:1787832850.270932:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787832850.271120:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787832850.271390:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832850.271410:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300877312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787832850.271479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832850.271582:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300877312 00000100:00100000:0.0:1787832850.271590:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300877312 00000100:00100000:0.0:1787832850.271654:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787832850.271663:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300877312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787832850.271688:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787832850.271748:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a902a0f, atime: 0x6a902a0f, ctime: 0x6a902a0f, blocks: 0xb 00010000:00010000:0.0:1787832850.271757:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.271773:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1787832850.271779:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832850.271785:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.271800:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.271809:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.271816:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.271833:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787832850.272768:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787832850.273218:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832850.273227:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.276280:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832850.276286:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.276315:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.276351:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.276361:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ae7d802/0x72bd9178b14b77ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.276389:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832850.276392:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832850.276395:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832850.279683:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300877312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8011us (8193us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787832850.279698:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787832850.279801:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787832850.279807:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787832850.279833:0:3305:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c357bb461c0 x1874678300877312/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787832866 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787832850.279847:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c357bb461c0/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787832850.279852:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300877312:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1787832850.313319:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832850.313329:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832850.313379:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787832850.313386:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787832850.322473:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832850.322481:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832850.322516:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787832850.322523:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787832850.322647:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b80a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300877440:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787832850.322770:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3545211840 going to sleep for 11 seconds 00000100:00100000:3.0:1787832850.335727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.335762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283055104 00000100:00100000:3.0:1787832850.335770:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283055104 00000100:00100000:3.0:1787832850.335835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:3.0:1787832850.335847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283055104:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787832850.335880:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787832850.336030:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b80a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300877440:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787832850.336381:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:11518:x1874678283055104:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 536us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832850.336389:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00080000:3.0:1787832850.336413:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832850.350079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.350163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283055232 00000100:00100000:0.0:1787832850.350193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283055232 00000100:00100000:0.0:1787832850.350271:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:0.0:1787832850.350283:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:11518:x1874678283055232:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.350356:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350372:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350436:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350444:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350450:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350476:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350483:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350490:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832850.350528:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787832850.350533:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832850.350553:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350565:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350571:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350577:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350582:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.350586:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350592:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350604:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:0.0:1787832850.350607:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832850.350612:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350618:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b77f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350631:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350637:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350643:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350656:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.350659:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350666:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832850.350678:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832850.350681:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350688:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b77fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350723:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350731:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350737:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350743:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.350746:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350751:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:0.0:1787832850.350774:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832850.350778:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.350784:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.350872:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:11518:x1874678283055232:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832850.350881:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:2.0:1787832850.354844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.354986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283055488 00000100:00100000:0.0:1787832850.355001:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283055488 00000100:00100000:0.0:1787832850.355082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:0.0:1787832850.355094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+16:11518:x1874678283055488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.355126:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832850.355148:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7809 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069ce expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355362:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355378:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355391:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832850.355403:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787832850.355638:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355647:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355653:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355659:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.355663:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355671:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355687:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:0.0:1787832850.355690:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832850.355694:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355729:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355775:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7809 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ce expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355786:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:0.0:1787832850.355788:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832850.355791:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7809 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ce expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.355823:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832850.357009:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283055488:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 800us (1067us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787832850.357026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 173 00000100:00100000:0.0:1787832850.372064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832850.375504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283055616 00000100:00100000:1.0:1787832850.375521:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283055616 00000100:00100000:1.0:1787832850.375599:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:1.0:1787832850.375610:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283055616:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787832850.375671:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787832850.375865:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283055616:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 255us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832850.375872:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 174 00000100:00100000:1.0:1787832850.381304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.381363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283055872 00000100:00100000:3.0:1787832850.381373:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283055872 00000100:00100000:3.0:1787832850.381443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:3.0:1787832850.381456:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283055872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832850.381478:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832850.381482:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787832850.381514:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b77c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c0 expref: 17 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.381555:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832850.381562:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832850.381579:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b781e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069d5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832850.383124:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787832850.383386:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.383404:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.383416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.383487:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b781e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069d5 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.383509:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069d5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.383519:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832850.383522:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832850.383526:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832850.383623:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283055872:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2170us (2330us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787832850.383633:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 175 00000100:00100000:2.0:1787832850.410932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.411923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283056128 00000100:00100000:2.0:1787832850.411935:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283056128 00000100:00100000:2.0:1787832850.412006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:2.0:1787832850.412017:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283056128:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787832850.412190:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832850.412217:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069d5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.412307:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:2.0:1787832850.412386:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832850.412410:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.412425:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.412435:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414013:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414045:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414439:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414447:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414455:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414461:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832850.414466:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414475:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414490:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832850.414493:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832850.414497:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414503:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b7833 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414516:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414523:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414536:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414541:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832850.414544:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414550:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd5a0b11f (ffff8c3547ea9300) 00010000:00010000:1.0:1787832850.414561:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832850.414564:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.414569:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b783a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd5a0b11f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832850.414681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283056128:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 2662us (3756us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787832850.414690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:0.0:1787832850.420455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.420548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283056256 00000100:00100000:3.0:1787832850.420559:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283056256 00000100:00100000:3.0:1787832850.420618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:3.0:1787832850.420628:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283056256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832850.420649:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832850.420671:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7841 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069dc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420732:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420746:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420756:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420854:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420872:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.420881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:3.0:1787832850.420884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787832850.420887:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832850.421831:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283056256:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1200us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832850.421841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:1.0:1787832850.429343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.429458:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283056512 00000100:00100000:2.0:1787832850.429471:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283056512 00000100:00100000:2.0:1787832850.429565:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:2.0:1787832850.429576:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283056512:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787832850.429661:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.429679:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.429692:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787832850.430041:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787832850.430052:0:10395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373458349095ns, next at 374458346747ns, rc = 0 00000004:00010000:2.0:1787832850.430152:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8839826 reply state 0000000082bdc894 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.430162:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832850.434130:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11518:x1874678283056512:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 4543us (4785us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787832850.434143:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 178 00000100:00100000:1.0:1787832850.457212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:2.0:1787832850.457289:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457301:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457309:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457315:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832850.457320:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457328:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457345:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:2.0:1787832850.457349:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787832850.457354:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.457360:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b784f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832850.457482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283056640 00000100:00100000:3.0:1787832850.457491:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283056640 00000100:00100000:3.0:1787832850.457542:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:3.0:1787832850.457551:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3560353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11518:x1874678283056640:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832850.457573:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832850.457589:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069e3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.457639:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.457652:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.457667:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:3.0:1787832850.457670:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832850.457672:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832850.457751:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3560353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11518:x1874678283056640:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 200us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832850.457758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 179 00000100:00100000:3.0:1787832850.464976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.468026:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283056768 00000100:00100000:0.0:1787832850.468048:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283056768 00000100:00100000:0.0:1787832850.468107:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1787832850.468117:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3558b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2352:x1874678283056768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787832850.468427:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3558b64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283056768:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 311us (3461us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787832850.468436:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00080000:3.0:1787832850.468606:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832850.476077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.476241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057024 00000100:00100000:3.0:1787832850.476251:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057024 00000100:00100000:3.0:1787832850.476314:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:3.0:1787832850.476325:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11518:x1874678283057024:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787832850.476571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11518:x1874678283057024:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 247us (503us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787832850.476587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1787832850.499185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.499662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057280 00000100:00100000:0.0:1787832850.499673:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057280 00000100:00100000:0.0:1787832850.499747:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:0.0:1787832850.499758:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11518:x1874678283057280:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787832850.502071:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11518:x1874678283057280:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 2303us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832850.502085:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 180 00000100:00100000:0.0:1787832850.513081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832850.515104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057408 00000100:00100000:1.0:1787832850.515116:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057408 00000100:00100000:1.0:1787832850.515178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:1.0:1787832850.515187:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11518:x1874678283057408:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832850.515227:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832850.515246:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b785d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069ea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515313:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515327:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515337:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832850.515370:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832850.515386:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515408:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b785d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ea expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515422:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ea expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.515429:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:1.0:1787832850.515432:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787832850.515435:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40a00, rc 0) 00000100:00100000:1.0:1787832850.515494:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11518:x1874678283057408:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 308us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832850.515500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:1.0:1787832850.523851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.524018:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057536 00000100:00100000:3.0:1787832850.524040:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057536 00000100:00100000:3.0:1787832850.524102:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1787832850.524112:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283057536:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832850.524132:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832850.524153:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069f1 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832850.524185:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902a13, blocks: 0x1 00010000:00010000:3.0:1787832850.524206:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1787832850.524211:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832850.524223:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.524242:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.524255:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832850.524320:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3546494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283057536:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 209us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832850.524327:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:2.0:1787832850.531143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832850.532438:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057792 00000100:00100000:1.0:1787832850.532451:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057792 00000100:00100000:1.0:1787832850.532517:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:1.0:1787832850.532529:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11518:x1874678283057792:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787832850.532647:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11518:x1874678283057792:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 120us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832850.532656:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:1.0:1787832850.544345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.544572:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283057920 00000100:00100000:0.0:1787832850.544583:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283057920 00000100:00100000:0.0:1787832850.544657:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1787832850.544674:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:11518:x1874678283057920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.544694:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832850.544755:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069f8 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.544789:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.544798:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832850.544802:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832850.544807:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.544839:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.544863:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 9 pid: 8408 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.544877:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464fcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300877568:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832850.544971:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546524a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832850.558262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832850.558297:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058048 00000100:00100000:1.0:1787832850.558306:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058048 00010000:00010000:1.0:1787832850.558346:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 10 pid: 8408 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832850.558383:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:1.0:1787832850.558394:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283058048:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832850.558410:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832850.558432:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 10 pid: 8408 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.558447:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 10 pid: 8408 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.558475:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832850.558480:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832850.558496:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.558508:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.558547:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832850.558562:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1874678300877696:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787832850.558585:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b786b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f1 expref: 10 pid: 8408 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.558599:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464fcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300877568:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832850.558633:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f05cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787832850.558639:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.558649:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:2.0:1787832850.558678:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:11518:x1874678283057920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 14006us (14343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.558685:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1787832850.561841:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1874678300877696:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787832850.561992:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832850.570100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.570235:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283058048:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 11501us (11644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.570249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:1.0:1787832850.577013:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058176 00000100:00100000:1.0:1787832850.577036:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058176 00002000:00100000:1.0:1787832850.577093:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c35661583c0 x1874678283058176/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:411/0 lens 504/0 e 0 to 0 dl 1787832861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832850.577105:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c35661583c0 with x1874678283058176 ext(0->8) 00002000:00010000:1.0:1787832850.577111:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c35661583c0 00000100:00100000:1.0:1787832850.577147:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1787832850.577156:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35661583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283058176:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787832850.577723:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35661583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283058176:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 566us (7629us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787832850.577732:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00002000:00100000:1.0:1787832850.577739:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c35661583c0 x1874678283058176/t4294967315(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:411/0 lens 504/448 e 0 to 0 dl 1787832861 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832850.577748:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c35661583c0 with x1874678283058176 ext(0->8) 00002000:00010000:1.0:1787832850.577757:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c35661583c0 00000100:00100000:1.0:1787832850.584387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.584523:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058304 00000100:00100000:3.0:1787832850.584534:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058304 00000100:00100000:3.0:1787832850.584616:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:3.0:1787832850.584626:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11518:x1874678283058304:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787832850.619601:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:1.0:1787832850.619621:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787832850.619627:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787832850.619648:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787832850.619661:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787832850.619676:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787832850.619689:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787832850.619933:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300877824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787832850.620009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832850.620056:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283058304:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 35428us (35676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832850.620068:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 183 00000100:00100000:2.0:1787832850.620145:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300877824 00000100:00100000:2.0:1787832850.620154:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300877824 00000100:00100000:2.0:1787832850.620232:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787832850.620241:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35661592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300877824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787832850.620394:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787832850.620398:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787832851 00002000:00010000:2.0:1787832850.620400:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787832850.620402:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787832851 -> 1787832851 00002000:00010000:2.0:1787832850.620405:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787832850.620443:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35661592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300877824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (435us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787832850.620465:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787832850.620533:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787832850.620832:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c357b808f00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1787832850.620839:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300877824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787832850.624059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.625949:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058432 00000100:00100000:2.0:1787832850.625963:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058432 00000100:00100000:2.0:1787832850.626047:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1787832850.626060:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2352:x1874678283058432:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787832850.682788:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2352:x1874678283058432:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 56719us (58753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832850.682803:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1787832850.686446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832850.686540:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058688 00000100:00100000:3.0:1787832850.686549:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058688 00000100:00100000:3.0:1787832850.686609:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 184 00000100:00100000:3.0:1787832850.686620:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283058688:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832850.686845:0:10395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832850.686874:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ea expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.686893:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:3.0:1787832850.686898:0:10395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832850.686925:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.686940:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.686950:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832850.687349:0:10395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8b09f82 reply state 000000002d331c00 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832850.687360:0:10395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832850.687465:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11518:x1874678283058688:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 846us (1028us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787832850.687475:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 184 00000001:00080000:1.0:1787832850.687648:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787832850.687664:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787832850.687696:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00010000:00010000:1.0:1787832850.690651:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690806:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690814:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690820:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832850.690825:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690834:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690866:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:1.0:1787832850.690869:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832850.690874:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.690880:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.693142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.693306:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283058816 00000100:00100000:2.0:1787832850.693316:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283058816 00000100:00100000:2.0:1787832850.693379:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832850.693390:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283058816:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787832850.693688:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787832850.693692:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787832851 -> 1787832849 00002000:00010000:2.0:1787832850.693695:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787832847 00002000:00010000:2.0:1787832850.693697:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787832851 -> 1787832849 00002000:00010000:2.0:1787832850.693725:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787832850.693800:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283058816:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 411us (668us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787832850.693810:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832850.698221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.698431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059072 00000100:00100000:0.0:1787832850.698444:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059072 00000100:00100000:0.0:1787832850.698541:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:0.0:1787832850.698551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:11518:x1874678283059072:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.698619:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.698636:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.698645:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.698852:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.698869:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 18 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.698884:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300877952:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832850.699046:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787832850.703909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832850.704051:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300877952:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832850.704080:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.704180:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059200 00000100:00100000:2.0:1787832850.704188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059200 00010000:00010000:2.0:1787832850.704240:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 19 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.704283:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1787832850.704294:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2353:x1874678283059200:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832850.704329:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832850.704339:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 19 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704353:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 19 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704376:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069dc expref: 19 pid: 5844 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704394:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:2.0:1787832850.704400:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704410:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704418:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.704448:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832850.704512:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+18:2353:x1874678283059200:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 220us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.704520:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00010000:00010000:1.0:1787832850.704580:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704619:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704625:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704631:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704636:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832850.704640:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704658:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704667:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:1.0:1787832850.704669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787832850.704673:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832850.704679:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7880 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832850.704781:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283059072:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 6230us (6570us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787832850.704789:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 185 00000100:00100000:3.0:1787832850.708486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.708595:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059328 00000100:00100000:0.0:1787832850.708605:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059328 00000100:00100000:0.0:1787832850.708664:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787832850.708690:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566159a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283059328:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.709156:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.709178:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.709206:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832850.709210:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832850.709215:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.709251:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.709265:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 8 pid: 6696 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.709280:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300878080:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832850.709358:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787832850.716265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.716443:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300878080:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832850.716473:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832850.717137:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059456 00000100:00100000:1.0:1787832850.717146:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059456 00010000:00010000:2.0:1787832850.717311:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.717388:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:2.0:1787832850.717398:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283059456:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832850.717413:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832850.717436:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.717450:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.717474:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e8194a1/0x72bd9178b14b7872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069f8 expref: 9 pid: 6696 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.717491:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832850.717495:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832850.717501:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.717511:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.717545:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832850.717609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283059456:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 213us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.717617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00010000:00010000:0.0:1787832850.717678:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717694:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717740:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717749:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717769:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717776:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832850.717781:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717790:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717802:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.717810:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7887 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.717863:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566159a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2353:x1874678283059328:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 9182us (9388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832850.717871:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787832850.721311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832850.721453:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059712 00000100:00100000:0.0:1787832850.721463:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059712 00000100:00100000:0.0:1787832850.721529:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 186 00000100:00100000:0.0:1787832850.721540:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+17:11518:x1874678283059712:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787832850.721625:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721658:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721670:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721920:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721933:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721941:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721980:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.721994:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 18 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.722010:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300878208:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832850.722124:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832850.727568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.728126:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059840 00000100:00100000:2.0:1787832850.728136:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059840 00010000:00010000:2.0:1787832850.728185:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 19 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.728240:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:2.0:1787832850.728251:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2353:x1874678283059840:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832850.728269:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832850.728277:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 19 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.728291:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 19 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.728316:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:2.0:1787832850.728321:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.728330:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.728337:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.728358:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832850.728426:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2353:x1874678283059840:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 175us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.728454:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00010000:00010000:3.0:1787832850.730286:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069e3 expref: 18 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832850.730314:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35464ffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300878208:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832850.730341:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.730350:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.730356:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832850.730543:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787832850.730936:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787832850.730985:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787832850.731085:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300878336:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832850.731160:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832850.731197:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832850.731316:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300878336 00000100:00100000:2.0:1787832850.731322:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300878336 00000100:00100000:2.0:1787832850.731373:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787832850.731381:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10395:x1874678300878336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787832850.731455:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10395:x1874678300878336:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.731462:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787832850.731565:0:10395:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787832850.731570:0:10395:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c357b808f00, transno 4294967316 00000100:00100000:3.0:1787832850.731586:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300878336:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787832850.732046:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787832850.732099:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300878464:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832850.732136:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832850.732459:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832850.732884:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300878464 00000100:00100000:1.0:1787832850.732890:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300878464 00000100:00100000:1.0:1787832850.732975:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787832850.732986:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10395:x1874678300878464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787832850.733196:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566158780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10395:x1874678300878464:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (1057us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787832850.733203:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787832850.733274:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300878464:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787832850.733307:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733317:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733326:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733332:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832850.733336:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733344:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733359:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3543a9c900) 00010000:00010000:3.0:1787832850.733362:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832850.733367:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733374:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7895 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733417:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733424:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733430:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733435:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832850.733439:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733445:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733453:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:3.0:1787832850.733455:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832850.733458:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733463:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b77ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733482:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733495:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 21 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733504:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733538:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 21 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832850.733552:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 21 pid: 10395 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832850.733565:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566159680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300878592:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832850.733634:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832850.736589:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566159680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300878592:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832850.736618:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.738769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.739160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283059968 00000100:00100000:2.0:1787832850.739170:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283059968 00010000:00010000:2.0:1787832850.739212:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 22 pid: 10395 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832850.739264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:2.0:1787832850.739274:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:2353:x1874678283059968:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832850.739291:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832850.739297:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 22 pid: 10395 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739312:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 22 pid: 10395 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87200/0x72bd9178b14b77e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069c7 expref: 22 pid: 10395 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739353:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:2.0:1787832850.739373:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739384:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739393:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.739432:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832850.739489:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:2353:x1874678283059968:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 215us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832850.739496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00010000:00010000:0.0:1787832850.739692:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739736:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739756:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739764:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739770:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739776:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.739780:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739786:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739795:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:0.0:1787832850.739798:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832850.739803:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739808:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86c00/0x72bd9178b14b789c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739819:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739824:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739829:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739841:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832850.739845:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739851:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739860:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543a9c800) 00010000:00010000:0.0:1787832850.739863:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787832850.739866:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.739871:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b788e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832850.740099:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11518:x1874678283059712:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 18559us (18796us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787832850.740108:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 186 00000020:00080000:0.0:1787832850.740113:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787832850.740644:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832850.740650:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832850.741517:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787832850.741528:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787832850.747280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832850.747438:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283060224 00000100:00100000:2.0:1787832850.747449:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283060224 00000100:00100000:2.0:1787832850.747510:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1787832850.747521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11518:x1874678283060224:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787832850.748235:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787832850.748352:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787832850.748397:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748415:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748428:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748445:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748453:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748459:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832850.748482:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787832850.748571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11518:x1874678283060224:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1051us (1298us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787832850.748580:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000020:00080000:2.0:1787832850.748585:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787832850.749206:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832850.749214:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.749286:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610be00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832850.749292:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.749307:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.749329:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3547ea9500) 00010000:00010000:0.0:1787832850.749332:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787832850.749338:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.749344:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b78a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832850.749362:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832850.749363:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832850.749365:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832851.150297:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832851.213251:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832851.213280:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300878720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832851.213396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832851.213749:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300878720 00000100:00100000:2.0:1787832851.213759:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300878720 00000100:00100000:2.0:1787832851.213815:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787832851.213825:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300878720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787832851.213847:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787832851.213902:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874678300878720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832851.213910:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787832851.213995:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566159680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300878720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832851.731924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300878848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832851.732001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832851.732151:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300879104:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832851.732218:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832851.732223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300879232:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832851.732275:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300879104 00000100:00100000:1.0:1787832851.732282:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300879104 00000100:00100000:1.0:1787832851.732325:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300879232 00000100:00100000:1.0:1787832851.732328:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300879232 00000100:00100000:1.0:1787832851.732360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787832851.732368:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300879104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300879104:12345-0@lo:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832851.732426:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787832851.732443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787832851.732450:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300879232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732476:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300879232:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832851.732483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787832851.732501:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832851.732536:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3550b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300879232:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732546:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300879104:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732567:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3550b25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300879360:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832851.732607:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832851.732612:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300878976:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832851.732663:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300879360 00000100:00100000:1.0:1787832851.732673:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300879360 00000100:00100000:1.0:1787832851.732724:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787832851.732731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300879360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.732766:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300879360:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832851.732772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787832851.732788:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832851.732803:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3550b25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300879360:0@lo:400:kworker.0 00000100:00100000:2.0:1787832851.733085:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300878848 00000100:00100000:2.0:1787832851.733090:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300878848 00000100:00100000:2.0:1787832851.733129:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787832851.733138:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300878848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787832851.733169:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832851.733227:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300878848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832851.733234:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787832851.733257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300878976 00000100:00100000:2.0:1787832851.733260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300878976 00000100:00100000:2.0:1787832851.733286:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787832851.733293:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300878976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832851.733324:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300878976:12345-0@lo:400:kworker.0 Request processed in 31us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832851.733329:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787832851.733449:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300878976:0@lo:400:kworker.0 00000100:00100000:1.0:1787832851.733465:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300878848:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787832852.173243:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787832852.569130:0:12572:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787832852.569140:0:12572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787832852.569179:0:12572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787832852.569187:0:12572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787832852.803023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832852.804658:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283060480 00000100:00100000:1.0:1787832852.804671:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283060480 00000100:00100000:1.0:1787832852.804755:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00100000:1.0:1787832852.804766:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:11536:x1874678283060480:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832852.804791:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832852.804813:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b78aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b7069ff expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.805846:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b78b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.805869:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b78b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.805882:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b78b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832852.805897:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787832852.806143:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b78aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ff expref: 25 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.806160:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b78b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ff expref: 24 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.806168:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832852.806171:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832852.806175:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41400, rc 0) 00000100:00100000:1.0:1787832852.806242:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11536:x1874678283060480:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1479us (3230us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787832852.806251:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 187 00000100:00080000:1.0:1787832852.806281:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832852.815912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832852.819774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283060608 00000100:00100000:0.0:1787832852.819786:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283060608 00000100:00100000:0.0:1787832852.819847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 188 00000100:00100000:0.0:1787832852.819857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11536:x1874678283060608:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787832852.819932:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.819949:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.819972:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820008:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820015:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820498:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820508:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820516:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832852.820555:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820565:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820572:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820578:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820594:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832852.820598:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820606:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820618:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832852.820621:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832852.820625:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820631:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b78bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820643:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820649:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820655:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820660:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832852.820663:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820668:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820684:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1ff00) 00010000:00010000:0.0:1787832852.820687:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832852.820690:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820735:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820741:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820747:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820752:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832852.820755:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820761:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820768:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832852.820770:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832852.820773:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.820778:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b78cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832852.820871:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11536:x1874678283060608:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 1013us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832852.820879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 188 00000001:00080000:1.0:1787832852.827333:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1787832852.886391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832852.886562:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283060864 00000100:00100000:1.0:1787832852.886574:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283060864 00000100:00100000:1.0:1787832852.886643:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:1.0:1787832852.886653:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11539:x1874678283060864:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832852.886676:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832852.886699:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b78d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a06 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886834:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886849:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886873:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886905:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886913:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.886921:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887253:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887262:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887270:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832852.887280:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787832852.887364:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887372:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887377:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887383:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832852.887386:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887404:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887417:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832852.887420:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832852.887424:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887431:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41e00/0x72bd9178b14b78db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887442:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887447:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887453:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887458:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832852.887460:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887466:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887473:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3543c5a800) 00010000:00010000:1.0:1787832852.887475:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832852.887478:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887492:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b78e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887532:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b78d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 27 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887545:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 26 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832852.887552:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:1.0:1787832852.887554:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832852.887557:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832852.887615:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:11539:x1874678283060864:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 963us (1233us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787832852.887623:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 189 00000100:00100000:3.0:1787832852.894061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832852.894174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283060992 00000100:00100000:0.0:1787832852.894185:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283060992 00000100:00100000:0.0:1787832852.894314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:0.0:1787832852.894325:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:11539:x1874678283060992:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787832852.894402:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894431:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894456:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894464:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894470:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894475:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832852.894650:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894679:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894692:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:0.0:1787832852.894695:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832852.894750:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.894758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832852.894826:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566159680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:11539:x1874678283060992:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 504us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832852.894835:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 190 00000100:00100000:0.0:1787832852.897449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832852.897620:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283061248 00000100:00100000:2.0:1787832852.897630:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283061248 00000100:00100000:2.0:1787832852.897688:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787832852.897698:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+26:11539:x1874678283061248:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832852.897968:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:11539:x1874678283061248:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 270us (528us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787832852.897975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:1.0:1787832852.959500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832852.959614:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283061504 00000100:00100000:0.0:1787832852.959623:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283061504 00000100:00100000:0.0:1787832852.959695:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:0.0:1787832852.959743:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:11065:x1874678283061504:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832852.959768:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832852.959788:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a0d expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.959882:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.959898:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 28 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.959926:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.959960:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 28 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.959975:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 28 pid: 10395 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832852.960002:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300879488:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832852.960090:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832852.962785:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300879488:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832852.962813:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832852.963797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832852.963896:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283061632 00000100:00100000:2.0:1787832852.963904:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283061632 00010000:00010000:2.0:1787832852.963944:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 29 pid: 10395 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832852.963997:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:2.0:1787832852.964008:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:2352:x1874678283061632:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832852.964024:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832852.964031:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 29 pid: 10395 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964058:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 29 pid: 10395 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964079:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b78e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a06 expref: 29 pid: 10395 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964095:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832852.964100:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964109:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964116:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.964147:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832852.964211:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:2352:x1874678283061632:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 205us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832852.964218:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00010000:00010000:0.0:1787832852.964480:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.964489:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832852.964507:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787832852.964666:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b78fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 29 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.964681:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 28 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832852.964794:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:0.0:1787832852.964797:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787832852.964800:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832852.964841:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:11065:x1874678283061504:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5101us (5353us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787832852.964848:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 191 00000100:00100000:3.0:1787832852.969449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832852.969540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283061888 00000100:00100000:2.0:1787832852.969552:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283061888 00000100:00100000:2.0:1787832852.969618:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 192 00000100:00100000:2.0:1787832852.969628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+28:11065:x1874678283061888:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:2.0:1787832852.969920:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.969936:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.969960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832852.970027:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787832852.970052:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c42dd9a8 reply state 000000007b9293fb transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832852.970074:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787832852.970122:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787832852.970230:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11065:x1874678283061888:12345-192.168.201.34@tcp:36:bash.0 Request processed in 602us (791us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787832852.970238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 192 00000020:00080000:2.0:1787832852.970243:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787832852.972195:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972213:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972221:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972226:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832852.972231:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972239:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972254:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832852.972267:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832852.972273:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.972279:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7913 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832852.975867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832852.982913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062016 00000100:00100000:2.0:1787832852.982927:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062016 00000100:00100000:2.0:1787832852.983061:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:2.0:1787832852.983073:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:11065:x1874678283062016:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787832852.983099:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832852.983119:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b791a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a14 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.983177:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b791a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a14 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.983193:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b791a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a14 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832852.983213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832852.983216:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832852.983219:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610bc00, rc 0) 00000100:00100000:2.0:1787832852.983296:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11065:x1874678283062016:12345-192.168.201.34@tcp:101:bash.0 Request processed in 226us (7437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832852.983303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 193 00000100:00100000:1.0:1787832852.991817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832852.991911:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062144 00000100:00100000:3.0:1787832852.991921:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062144 00000100:00100000:3.0:1787832852.991999:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1787832852.992011:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:11065:x1874678283062144:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832852.992032:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832852.992067:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a1b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832852.992095:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a902a11, atime: 0x6a902a0f, ctime: 0x6a902a11, blocks: 0xb 00010000:00010000:3.0:1787832852.992131:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787832852.992136:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832852.992144:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832852.992162:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832852.992175:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832852.992240:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:11065:x1874678283062144:12345-192.168.201.34@tcp:101:bash.0 Request processed in 231us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832852.992246:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00080000:1.0:1787832852.992869:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832852.996534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832852.996642:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062272 00000100:00100000:1.0:1787832852.996653:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062272 00002000:00010000:1.0:1787832852.996693:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787832852.996699:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3566158000 with x1874678283062272 ext(0->18446744073709551615) 00002000:00010000:1.0:1787832852.996748:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3566158000. 00000100:00100000:1.0:1787832852.996773:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1787832852.996782:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283062272:12345-192.168.201.34@tcp:10:bash.0 00002000:00010000:1.0:1787832852.997115:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787832852.997120:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787832849 -> 1787832853 00002000:00010000:1.0:1787832852.997122:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787832847 -> 1787832847 00002000:00010000:1.0:1787832852.997124:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787832849 -> 1787832853 00002000:00010000:1.0:1787832852.997126:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787832852.997199:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283062272:12345-192.168.201.34@tcp:10:bash.0 Request processed in 416us (673us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787832852.997207:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00002000:00010000:1.0:1787832852.997211:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787832852.997214:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3566158000 with x1874678283062272 ext(0->18446744073709551615) 00002000:00010000:1.0:1787832852.997219:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3566158000. 00000100:00100000:3.0:1787832853.101287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.101658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062400 00000100:00100000:2.0:1787832853.101668:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062400 00000100:00100000:2.0:1787832853.101765:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:2.0:1787832853.101775:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11553:x1874678283062400:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:2.0:1787832853.101865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.101883:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.101895:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.101911:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.101919:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.101925:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.103996:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104016:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104027:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832853.104155:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104167:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104265:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104272:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104278:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.104283:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104290:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832853.104306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.104312:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104318:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104331:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104337:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104343:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104347:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.104357:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104363:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104372:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9900) 00010000:00010000:2.0:1787832853.104375:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.104378:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104384:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b792f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104399:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104405:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104410:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104415:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.104418:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104423:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104430:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832853.104432:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.104441:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.104447:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832853.104548:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566159e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11553:x1874678283062400:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 2771us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832853.104559:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 194 00000100:00100000:1.0:1787832853.152823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.154763:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062656 00000100:00100000:0.0:1787832853.154778:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062656 00000100:00100000:0.0:1787832853.154856:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:0.0:1787832853.154867:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11556:x1874678283062656:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832853.154889:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832853.154920:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b793d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a22 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155002:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155017:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155029:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155044:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155052:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155075:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155413:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155422:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155429:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832853.155439:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787832853.155533:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155541:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155548:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155555:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832853.155558:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155566:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155577:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832853.155580:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832853.155592:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155599:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155613:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155618:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155623:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155627:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832853.155630:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155635:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155642:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832853.155644:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832853.155647:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155653:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b794b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155693:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b793d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a22 expref: 35 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155796:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a22 expref: 34 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.155804:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:0.0:1787832853.155806:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787832853.155808:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832853.155892:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11556:x1874678283062656:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1026us (3080us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787832853.155900:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 195 00000100:00100000:3.0:1787832853.160945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.161079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283062784 00000100:00100000:0.0:1787832853.161089:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283062784 00000100:00100000:0.0:1787832853.161158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:0.0:1787832853.161168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11556:x1874678283062784:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787832853.161234:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.161251:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 34 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.161260:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.161294:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 34 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.161307:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 34 pid: 10395 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832853.161331:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300879616:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832853.161424:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832853.174102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.174314:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300879616:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832853.174342:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832853.174402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283063040 00000100:00100000:2.0:1787832853.174409:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283063040 00000100:00100000:2.0:1787832853.174467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:2.0:1787832853.174477:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:6057:x1874678283063040:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787832853.174853:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:6057:x1874678283063040:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 375us (759us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787832853.174860:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:1.0:1787832853.179431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.179551:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283063168 00000100:00100000:2.0:1787832853.179561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283063168 00010000:00010000:2.0:1787832853.179601:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 36 pid: 10395 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832853.179804:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1787832853.179816:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573838c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:2352:x1874678283063168:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832853.179832:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832853.179840:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 36 pid: 10395 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.179854:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 36 pid: 10395 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.179891:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7905 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a0d expref: 36 pid: 10395 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.179910:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832853.179915:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.179924:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.179933:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.180038:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832853.180113:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573838c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:2352:x1874678283063168:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 299us (691us total) trans 0 rc 0/0 00010000:00010000:0.0:1787832853.183934:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.183953:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184001:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184009:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184017:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184024:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832853.184027:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184034:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184051:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:0.0:1787832853.184080:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832853.184087:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.184093:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832853.184319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:11556:x1874678283062784:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 23147us (23377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832853.184332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 196 00000100:00100000:1.0:1787832853.190695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.191353:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:3.0:1787832853.191965:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283063424 00000100:00100000:3.0:1787832853.191975:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283063424 00000100:00100000:3.0:1787832853.192043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1787832853.192647:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+34:11556:x1874678283063424:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787832853.193046:0:5848:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787832853.193058:0:5848:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:0.0:1787832853.195934:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832853.197261:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:11556:x1874678283063424:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 4611us (6566us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787832853.197275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1787832853.368780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.368952:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283063680 00000100:00100000:0.0:1787832853.368963:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283063680 00000100:00100000:0.0:1787832853.369042:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:0.0:1787832853.369053:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+35:11567:x1874678283063680:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:0.0:1787832853.369078:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832853.369100:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a29 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369177:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369193:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369204:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369219:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369244:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369251:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369595:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b797c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369605:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369612:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832853.369623:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787832853.369927:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369936:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369943:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369949:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832853.369953:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369960:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.369993:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832853.369996:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832853.370001:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370008:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b796e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370024:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370029:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370033:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370039:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832853.370041:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370047:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370053:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832853.370055:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832853.370059:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370064:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370120:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a29 expref: 38 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370134:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b797c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a29 expref: 37 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.370140:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:0.0:1787832853.370142:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832853.370144:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030a00, rc 0) 00000100:00100000:0.0:1787832853.370208:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11567:x1874678283063680:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1157us (1436us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787832853.370218:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 197 00000100:00100000:1.0:1787832853.392468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.392989:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283063936 00000100:00100000:2.0:1787832853.393000:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283063936 00000100:00100000:2.0:1787832853.393070:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:2.0:1787832853.393080:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11567:x1874678283063936:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:2.0:1787832853.393359:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:11567:x1874678283063936:12345-192.168.201.34@tcp:35:cat.0 Request processed in 280us (901us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787832853.393368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:1.0:1787832853.434204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.434536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283064192 00000100:00100000:2.0:1787832853.434547:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283064192 00000100:00100000:2.0:1787832853.434687:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 198 00000100:00100000:2.0:1787832853.434753:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:11568:x1874678283064192:12345-192.168.201.34@tcp:36:rm.0 00010000:00010000:2.0:1787832853.434814:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787832853.434842:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b797c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a29 expref: 38 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434868:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a22 expref: 37 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434880:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b791a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a14 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434889:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3543c5a600) 00010000:00010000:2.0:1787832853.434901:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832853.434933:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434948:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434957:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434969:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.434976:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.435035:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.435355:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.435364:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.435371:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787832853.436051:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787832853.436062:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376464358948ns, next at 377464356463ns, rc = 0 00010000:00010000:2.0:1787832853.436120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436131:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436139:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436146:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436151:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436156:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436179:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832853.436199:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436212:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436219:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436224:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.436228:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436235:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3547ea9800) 00010000:00010000:2.0:1787832853.436247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787832853.436252:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436258:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7998 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436274:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436280:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436285:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436290:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.436299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436305:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436313:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832853.436315:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.436318:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.436324:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b798a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832853.436334:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000853e58a3 reply state 0000000019a40e2e transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832853.436342:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832853.436430:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b719e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+37:11568:x1874678283064192:12345-192.168.201.34@tcp:36:rm.0 Request processed in 1677us (2251us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787832853.436439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 198 00010000:00010000:3.0:1787832853.436494:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832853.436501:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.436517:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832853.436521:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.436527:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.436535:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3547ea9800) 00010000:00010000:3.0:1787832853.436538:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787832853.436541:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.436546:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b799f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.436559:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832853.436561:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832853.436563:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832853.440205:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440224:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440231:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440256:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832853.440261:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440270:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440288:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9900) 00010000:00010000:1.0:1787832853.440291:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832853.440296:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832853.440302:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7991 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832853.570633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832853.571221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283064448 00000100:00100000:2.0:1787832853.571232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283064448 00000100:00100000:2.0:1787832853.571295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:2.0:1787832853.571306:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b719a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+36:11574:x1874678283064448:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:2.0:1787832853.571331:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832853.571351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b79a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a30 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571479:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571510:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571521:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571538:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571546:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.571553:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787832853.572433:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787832853.572608:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572621:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572631:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572669:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572676:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572683:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572697:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.572733:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572743:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572756:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832853.572759:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.572764:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572771:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b79ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832853.572785:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ceea8695 reply state 0000000028b47db6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832853.572794:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787832853.572827:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b79a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572843:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.572849:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:2.0:1787832853.572851:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832853.572853:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610ba00, rc 0) 00000100:00100000:2.0:1787832853.572936:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b719a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:11574:x1874678283064448:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1631us (2312us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787832853.572950:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 199 00000100:00100000:1.0:1787832853.583877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00010000:00010000:2.0:1787832853.584220:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584233:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584242:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584249:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610bc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832853.584254:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584262:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584280:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9600) 00010000:00010000:2.0:1787832853.584283:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832853.584289:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832853.584297:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610bc00/0x72bd9178b14b79b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832853.584576:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283064576 00000100:00100000:3.0:1787832853.584586:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283064576 00000100:00100000:3.0:1787832853.584657:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:3.0:1787832853.584667:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2353:x1874678283064576:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832853.584686:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832853.584733:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a37 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832853.584764:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832853.584783:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1787832853.584788:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832853.584811:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.584832:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.584845:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:3.0:1787832853.584908:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283064576:12345-192.168.201.34@tcp:101:bash.0 Request processed in 242us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832853.584914:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00080000:1.0:1787832853.586340:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832853.597092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832853.597197:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283064704 00000100:00100000:3.0:1787832853.597207:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283064704 00000100:00100000:3.0:1787832853.597272:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787832853.597282:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:11574:x1874678283064704:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832853.597300:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832853.597317:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a3e expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.597350:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.597358:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832853.597362:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832853.597367:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.597399:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.597421:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 7 pid: 6695 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832853.597434:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356615a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874678300879744:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832853.597535:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832853.601539:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.601639:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283064832 00000100:00100000:0.0:1787832853.601648:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283064832 00010000:00010000:0.0:1787832853.601696:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 8 pid: 6695 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832853.601774:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:0.0:1787832853.601784:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2353:x1874678283064832:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832853.601799:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832853.601822:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 8 pid: 6695 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.601837:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 8 pid: 6695 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.601882:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832853.601887:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832853.601896:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.601906:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.601946:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832853.601960:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1874678300879872:192.168.201.34@tcp:105: 00000100:00100000:0.0:1787832853.602056:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787832853.602635:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc87680c/0x72bd9178b14b79c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a37 expref: 8 pid: 6695 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832853.602652:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356615a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874678300879744:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832853.602679:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832853.602691:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832853.602793:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:11574:x1874678283064704:12345-192.168.201.34@tcp:101:bash.0 Request processed in 5512us (5709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832853.602803:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:0.0:1787832853.616833:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1874678300879872:192.168.201.34@tcp:105: 00010000:00010000:0.0:1787832853.616861:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832853.616929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2353:x1874678283064832:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 15146us (15399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832853.616942:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1787832853.617465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832853.617752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065088 00000100:00100000:3.0:1787832853.617760:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065088 00000100:00100000:3.0:1787832853.617812:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787832853.617821:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+38:11574:x1874678283065088:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787832853.620091:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:11574:x1874678283065088:12345-192.168.201.34@tcp:35:bash.0 Request processed in 2260us (2617us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787832853.620106:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:2.0:1787832853.995669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832853.995816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065216 00000100:00100000:0.0:1787832853.995826:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065216 00000100:00100000:0.0:1787832853.995890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:0.0:1787832853.995901:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+39:11590:x1874678283065216:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832853.995926:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832853.995948:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b79d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a45 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996038:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996053:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996066:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832853.996125:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787832853.996129:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832853.996153:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996191:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b79d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a45 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996210:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a45 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832853.996219:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832853.996222:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832853.996226:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031600, rc 0) 00000100:00100000:0.0:1787832853.996279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b80a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11590:x1874678283065216:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 380us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832853.996286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 200 00000100:00100000:1.0:1787832854.012329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.012407:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065344 00000100:00100000:3.0:1787832854.012417:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065344 00000100:00100000:3.0:1787832854.012480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 302 00000100:00100000:3.0:1787832854.012490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283065344:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832854.012585:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2353:x1874678283065344:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.012592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 302 00000100:00100000:1.0:1787832854.023520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.023555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.023587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.023672:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065600 00000100:00100000:0.0:1787832854.023681:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065600 00000100:00100000:0.0:1787832854.025302:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065856 00000100:00100000:0.0:1787832854.025318:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065856 00000100:00100000:0.0:1787832854.025371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:0.0:1787832854.025382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283065600:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832854.025470:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2353:x1874678283065600:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 90us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.025477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 167 00000100:00100000:0.0:1787832854.025495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00100000:0.0:1787832854.025501:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+40:11590:x1874678283065856:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832854.025513:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832854.025534:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b79e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a4c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.025649:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b79ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.025663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b79ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.025674:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b79ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832854.025686:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787832854.025844:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b79e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a4c expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.025862:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b79ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a4c expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.025888:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:0.0:1787832854.025892:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832854.025896:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:0.0:1787832854.025919:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+42:11590:x1874678283065856:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 418us (2332us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787832854.025926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 201 00000100:00080000:1.0:1787832854.026733:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832854.027206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283065472 00000100:00100000:3.0:1787832854.027216:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283065472 00000100:00100000:3.0:1787832854.027298:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787832854.027308:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283065472:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832854.027381:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2353:x1874678283065472:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.027389:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00080000:1.0:1787832854.027582:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832854.038479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.038525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.038588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066112 00000100:00100000:0.0:1787832854.038598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066112 00000100:00100000:0.0:1787832854.038662:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:0.0:1787832854.038673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+42:11590:x1874678283066112:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832854.038697:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832854.038745:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b79fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.038845:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.038859:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.038869:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832854.038882:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787832854.039013:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b79fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a53 expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.039050:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a53 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.039059:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:0.0:1787832854.039074:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787832854.039078:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832854.039136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+44:11590:x1874678283066112:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 465us (668us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787832854.039144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 202 00000100:00100000:3.0:1787832854.039762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066240 00000100:00100000:3.0:1787832854.039769:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066240 00000100:00100000:3.0:1787832854.039818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787832854.039825:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+44:2354:x1874678283066240:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832854.039834:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832854.039847:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b79ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a4c expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.039856:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:3.0:1787832854.039859:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832854.039888:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:2354:x1874678283066240:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 64us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.039903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1787832854.047932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.048110:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066368 00000100:00100000:0.0:1787832854.048121:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066368 00000100:00100000:0.0:1787832854.048189:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:0.0:1787832854.048198:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+6:2354:x1874678283066368:12345-192.168.201.34@tcp:1:lfs.0 00010000:00010000:0.0:1787832854.048246:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.048266:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.048275:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787832854.048279:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787832854.048284:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.048322:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.048345:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 6 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.048362:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300880000:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832854.048463:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832854.053429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.053508:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066496 00000100:00100000:3.0:1787832854.053518:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066496 00002000:00100000:3.0:1787832854.053569:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c35660943c0 x1874678283066496/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:415/0 lens 504/0 e 0 to 0 dl 1787832865 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832854.053581:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c35660943c0 with x1874678283066496 ext(0->8) 00010000:00010000:3.0:1787832854.053591:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 7 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.053607:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 7 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832854.053615:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c35660943c0 00000100:00100000:3.0:1787832854.053650:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:3.0:1787832854.053659:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283066496:12345-192.168.201.34@tcp:4:lfs.0 00000100:00100000:3.0:1787832854.054298:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283066496:12345-192.168.201.34@tcp:4:lfs.0 Request processed in 637us (877us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787832854.054307:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00002000:00100000:3.0:1787832854.054314:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c35660943c0 x1874678283066496/t4294967308(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:415/0 lens 504/448 e 0 to 0 dl 1787832865 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787832854.054323:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c35660943c0 with x1874678283066496 ext(0->8) 00010000:00010000:3.0:1787832854.054329:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.054352:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832854.054359:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c35660943c0 00000100:00100000:0.0:1787832854.054598:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8408:1874678300880000:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832854.054620:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832854.058269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.058362:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066624 00000100:00100000:3.0:1787832854.058372:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066624 00010000:00010000:3.0:1787832854.058416:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.058460:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:3.0:1787832854.058469:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2354:x1874678283066624:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832854.058484:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787832854.058545:0:8455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787832854.058548:0:8455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787832854 00002000:00010000:3.0:1787832854.058550:0:8455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787832854 00002000:00010000:3.0:1787832854.058553:0:8455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787832854 00010000:00010000:3.0:1787832854.058559:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.058573:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.058599:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fa6000/0x72bd9178b14b79d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a3e expref: 9 pid: 6697 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.058630:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832854.058635:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832854.058640:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.058651:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.058992:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832854.059063:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2354:x1874678283066624:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 593us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.059073:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00010000:00010000:1.0:1787832854.060424:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060440:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060474:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060482:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060490:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060497:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832854.060501:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060510:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060527:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.060555:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029615be8/0x72bd9178b14b7a0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832854.061686:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283066368:12345-192.168.201.34@tcp:1:lfs.0 Request processed in 13480us (13756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832854.061699:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1787832854.070262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.070571:0:12588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283066880 00000100:00100000:2.0:1787832854.070582:0:12588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283066880 00000100:00100000:2.0:1787832854.070644:0:12588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:2.0:1787832854.070669:0:12588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+43:11590:x1874678283066880:12345-192.168.201.34@tcp:35:lfs.0 00000004:00010000:2.0:1787832854.070770:0:12588:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a53 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832854.071083:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787832854.071129:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787832854.071681:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787832854.072463:0:12588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.072484:0:12588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.072493:0:12588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.072531:0:12588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.072546:0:12588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 47 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832854.072560:0:12588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12588:1874678300880128:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832854.072655:0:12588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787832854.077405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.077508:0:12588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12588:1874678300880128:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832854.077537:0:12588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.077609:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067008 00000100:00100000:3.0:1787832854.077616:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067008 00010000:00010000:3.0:1787832854.077652:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 48 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.077691:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:3.0:1787832854.077746:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+48:2353:x1874678283067008:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832854.077765:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832854.077773:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 48 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.077786:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 48 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.077830:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b79bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a30 expref: 48 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.077846:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:3.0:1787832854.077852:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.077861:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.077870:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.078064:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832854.078210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+47:2353:x1874678283067008:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 509us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.078220:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00010000:00010000:1.0:1787832854.080958:0:12588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.080986:0:12588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832854.081339:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787832854.081552:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787832854.082123:0:12588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12588:1874678300880256:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787832854.082276:0:12588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832854.082372:0:12588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3558b193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832854.082418:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300880256 00000100:00100000:2.0:1787832854.082425:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300880256 00000100:00100000:2.0:1787832854.082533:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832854.082543:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12588:x1874678300880256:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787832854.082638:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12588:x1874678300880256:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 96us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.082646:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787832854.082855:0:12588:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787832854.082861:0:12588:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c357bb461c0, transno 4294967307 00000100:00100000:0.0:1787832854.082881:0:12588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12588:1874678300880256:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787832854.086447:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787832854.086551:0:12588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12588:1874678300880384:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787832854.086622:0:12588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832854.086908:0:12588:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305bcc0 going to sleep for 11 seconds 00000100:00080000:1.0:1787832854.087206:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832854.087328:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300880384 00000100:00100000:2.0:1787832854.087338:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300880384 00000100:00100000:2.0:1787832854.087441:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832854.087452:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12588:x1874678300880384:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787832854.087666:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12588:x1874678300880384:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 213us (1041us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787832854.087674:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832854.087934:0:12588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12588:1874678300880384:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787832854.088016:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787832854.088075:0:12588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088086:0:12588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088094:0:12588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088099:0:12588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.088104:0:12588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088113:0:12588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088129:0:12588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:0.0:1787832854.088133:0:12588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787832854.088138:0:12588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.088145:0:12588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a600/0x72bd9178b14b7a16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787832854.088339:0:12588:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787832854.088434:0:12588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787832854.088446:0:12588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377116743334ns, next at 378116740910ns, rc = 0 00000001:00080000:0.0:1787832854.088453:0:12588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787832854.088502:0:12588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3547ea9700) 00010000:00010000:0.0:1787832854.088506:0:12588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787832854.088514:0:12588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a53 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.088625:0:12588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:11590:x1874678283066880:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 17959us (18374us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787832854.088633:0:12588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000020:00080000:0.0:1787832854.088637:0:12588:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787832854.091785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.092183:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067136 00000100:00100000:0.0:1787832854.092194:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067136 00000100:00100000:0.0:1787832854.092260:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:0.0:1787832854.092270:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+50:11590:x1874678283067136:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832854.092296:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832854.092321:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7a1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a5a expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.092385:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a5a expref: 51 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.092399:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7a1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a5a expref: 51 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.092419:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.092423:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787832854.092427:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:0.0:1787832854.092492:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11590:x1874678283067136:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 223us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.092516:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 203 00000100:00100000:1.0:1787832854.102276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.102384:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067392 00000100:00100000:2.0:1787832854.102395:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067392 00000100:00100000:2.0:1787832854.102464:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832854.102474:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+51:11590:x1874678283067392:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832854.103182:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11590:x1874678283067392:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 705us (912us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787832854.103193:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00010000:00010000:2.0:1787832854.222653:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832854.281897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.282284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067520 00000100:00100000:0.0:1787832854.282308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067520 00000100:00100000:0.0:1787832854.282462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:0.0:1787832854.282474:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11601:x1874678283067520:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:0.0:1787832854.282576:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282598:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282613:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282633:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282640:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282647:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282823:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282850:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787832854.282940:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282957:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282989:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.282997:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283003:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.283009:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283016:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283030:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832854.283033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832854.283038:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283045:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283063:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283069:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283087:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.283090:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283097:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283105:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1ff00) 00010000:00010000:0.0:1787832854.283107:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832854.283110:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283133:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283139:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283145:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283150:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.283152:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283170:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283179:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.283181:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832854.283185:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.283196:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.283294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566158f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11601:x1874678283067520:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 820us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.283304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 204 00000100:00100000:3.0:1787832854.365647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.365857:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067776 00000100:00100000:0.0:1787832854.365870:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067776 00000100:00100000:0.0:1787832854.365950:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:0.0:1787832854.365972:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+52:11604:x1874678283067776:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832854.366002:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832854.366032:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a61 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366126:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366146:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366160:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366188:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366196:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366202:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366379:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366388:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366394:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832854.366404:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787832854.366526:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366534:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366540:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366547:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.366552:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366571:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366588:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832854.366591:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832854.366597:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366603:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031800/0x72bd9178b14b7a40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366633:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366641:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366647:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366652:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832854.366654:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366660:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366667:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1ff00) 00010000:00010000:0.0:1787832854.366670:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832854.366673:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366690:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366816:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a61 expref: 55 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366835:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a61 expref: 54 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.366842:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.366845:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832854.366848:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:3.0:1787832854.367134:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11604:x1874678283067776:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1171us (1514us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787832854.367145:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 205 00000100:00100000:1.0:1787832854.371165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.371324:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283067904 00000100:00100000:2.0:1787832854.371338:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283067904 00000100:00100000:2.0:1787832854.371458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:2.0:1787832854.371471:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11604:x1874678283067904:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:2.0:1787832854.371563:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371584:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371784:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371823:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371831:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371838:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371845:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.371850:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371857:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371872:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832854.371875:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832854.371880:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.371887:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b000/0x72bd9178b14b7a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832854.371997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11604:x1874678283067904:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 528us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.372006:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 206 00000100:00100000:1.0:1787832854.378981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.379073:0:12588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283068160 00000100:00100000:0.0:1787832854.379086:0:12588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283068160 00000100:00100000:0.0:1787832854.379166:0:12588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787832854.379179:0:12588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+54:11604:x1874678283068160:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787832854.385676:0:12588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:11604:x1874678283068160:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 6479us (6699us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787832854.385696:0:12588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787832854.528840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.529185:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283068416 00000100:00100000:1.0:1787832854.529199:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283068416 00000100:00100000:1.0:1787832854.529472:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:1.0:1787832854.529484:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356615a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+55:11614:x1874678283068416:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832854.530401:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832854.530408:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787832854.530454:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b79de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a45 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.530482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832854.530488:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832854.530646:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7a63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a68 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.530885:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.530903:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.530915:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832854.530927:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787832854.531110:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7a63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a68 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.531127:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a68 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.531135:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832854.531165:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832854.531169:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40600, rc 0) 00000100:00100000:1.0:1787832854.531267:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356615a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11614:x1874678283068416:12345-192.168.201.34@tcp:101:bash.0 Request processed in 1784us (2443us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787832854.531277:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 207 00000100:00100000:2.0:1787832854.540990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.541131:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283068672 00000100:00100000:0.0:1787832854.541145:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283068672 00000100:00100000:0.0:1787832854.541243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 208 00000100:00100000:0.0:1787832854.541256:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11614:x1874678283068672:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:0.0:1787832854.541343:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787832854.541379:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a68 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.541408:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a61 expref: 55 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.541435:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.541442:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832854.541797:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.541815:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.541827:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787832854.541893:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787832854.541921:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042585704 reply state 00000000353f6836 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.541931:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832854.542076:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11614:x1874678283068672:12345-192.168.201.34@tcp:36:bash.0 Request processed in 819us (1111us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787832854.542085:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 208 00000020:00080000:0.0:1787832854.542092:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787832854.548885:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548904:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548913:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548920:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832854.548926:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548935:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548955:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832854.548969:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832854.548976:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.548984:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7a78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.549351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.555509:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283068800 00000100:00100000:1.0:1787832854.555531:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283068800 00000100:00100000:1.0:1787832854.555675:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:1.0:1787832854.555736:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+56:11614:x1874678283068800:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832854.555771:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832854.555801:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a6f expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.555909:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.555926:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.555940:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832854.555988:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787832854.555993:0:10395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832854.556018:0:10395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.557129:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40a00/0x72bd9178b14b7a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 58 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.557575:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 57 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832854.557589:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832854.557592:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832854.557596:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41c00, rc 0) 00000100:00100000:1.0:1787832854.557732:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11614:x1874678283068800:12345-192.168.201.34@tcp:101:bash.0 Request processed in 2000us (9018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832854.557763:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 209 00000100:00100000:3.0:1787832854.565016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.565133:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069056 00000100:00100000:1.0:1787832854.565143:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069056 00000100:00100000:1.0:1787832854.565210:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:1.0:1787832854.565221:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+57:11614:x1874678283069056:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:1.0:1787832854.565486:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+58:11614:x1874678283069056:12345-192.168.201.34@tcp:35:bash.0 Request processed in 266us (482us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787832854.565496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:2.0:1787832854.688843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.688967:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069184 00000100:00100000:0.0:1787832854.688978:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069184 00000100:00100000:0.0:1787832854.689144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:0.0:1787832854.689168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+58:11620:x1874678283069184:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832854.689196:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832854.689221:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a76 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689324:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689338:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689351:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832854.689410:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787832854.689414:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832854.689437:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689464:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a76 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689489:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a76 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.689498:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:0.0:1787832854.689501:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832854.689505:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832854.689570:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3550b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283069184:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 416us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.689578:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 210 00000100:00100000:3.0:1787832854.693487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.703356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069312 00000100:00100000:2.0:1787832854.703373:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069312 00000100:00100000:2.0:1787832854.703452:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:2.0:1787832854.703463:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283069312:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832854.703483:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832854.703506:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7a9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a7d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703694:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703731:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703745:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703762:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703770:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703778:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703883:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703893:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.703916:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832854.703978:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787832854.703983:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832854.704003:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704017:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704026:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704034:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704043:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704049:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.704054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704062:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704075:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832854.704079:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.704083:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704101:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704116:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704123:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704129:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704147:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.704150:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704157:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704165:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3547ea9600) 00010000:00010000:2.0:1787832854.704169:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.704172:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704179:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704216:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7a9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a7d expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a7d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.704245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832854.704248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832854.704250:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610be00, rc 0) 00000100:00100000:2.0:1787832854.704328:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11620:x1874678283069312:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 866us (10849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.704335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 211 00000100:00100000:1.0:1787832854.710180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.710290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.710737:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069696 00000100:00100000:0.0:1787832854.710749:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069696 00000100:00100000:0.0:1787832854.710838:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787832854.710848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:2353:x1874678283069696:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832854.710864:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832854.710890:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610be00/0x72bd9178b14b7ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a7d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.710910:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.710915:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832854.710988:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:2353:x1874678283069696:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 141us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.710995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787832854.713201:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069568 00000100:00100000:3.0:1787832854.713216:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069568 00000100:00100000:3.0:1787832854.713328:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:3.0:1787832854.713339:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283069568:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832854.713378:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832854.713401:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a84 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.713510:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.713525:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 60 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.713533:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.713585:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 60 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.713600:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 60 pid: 10395 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.713612:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300880512:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832854.713786:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832854.719368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.719470:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283069824 00000100:00100000:0.0:1787832854.719479:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283069824 00010000:00010000:0.0:1787832854.719518:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 61 pid: 10395 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.719597:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:0.0:1787832854.719609:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:2352:x1874678283069824:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832854.719628:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832854.719636:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 61 pid: 10395 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.719654:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 61 pid: 10395 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.719678:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.719692:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.719763:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41c00/0x72bd9178b14b7a86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a6f expref: 61 pid: 10395 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.719766:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.719805:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.719825:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300880512:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832854.719833:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832854.719876:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.719905:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:2352:x1874678283069824:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 293us (541us total) trans 0 rc 0/0 00010000:00010000:3.0:1787832854.719913:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.719922:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00010000:00010000:3.0:1787832854.719934:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832854.719971:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787832854.720191:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 61 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.720210:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 60 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.720283:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832854.720287:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787832854.720290:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:3.0:1787832854.720359:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11620:x1874678283069568:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 7022us (10190us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787832854.720369:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 212 00000100:00100000:1.0:1787832854.724472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.724569:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070080 00000100:00100000:0.0:1787832854.724582:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070080 00000100:00100000:0.0:1787832854.724680:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1787832854.724693:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357383b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11620:x1874678283070080:12345-192.168.201.34@tcp:103:lfs.0 00010000:00010000:0.0:1787832854.724756:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832854.724795:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7a1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a5a expref: 60 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.724823:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832854.724829:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832854.725080:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357383b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283070080:12345-192.168.201.34@tcp:103:lfs.0 Request processed in 389us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832854.725089:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787832854.728089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832854.728173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070208 00000100:00100000:0.0:1787832854.728184:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070208 00000100:00100000:0.0:1787832854.728262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:0.0:1787832854.728273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283070208:12345-192.168.201.34@tcp:58:lfs.0 00010000:00010000:0.0:1787832854.728435:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.728458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832854.728474:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787832854.732060:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787832854.732252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283070208:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 3972us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832854.732269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 213 00000100:00100000:1.0:1787832854.738111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.738218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070336 00000100:00100000:2.0:1787832854.738231:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070336 00000100:00100000:2.0:1787832854.738309:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 214 00000100:00100000:2.0:1787832854.738321:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+59:11620:x1874678283070336:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832854.738349:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832854.738376:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a8b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738452:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738463:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738486:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738499:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738513:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832854.738528:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787832854.738533:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.738541:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610b400, rc 0) 00000100:00100000:2.0:1787832854.738614:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11620:x1874678283070336:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 297us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.738622:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 214 00000040:00080000:2.0:1787832854.860172:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832854.860185:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832854.860235:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787832854.860242:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787832854.860426:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565c72940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300880640:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787832854.860588:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832854.866055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.866138:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070464 00000100:00100000:3.0:1787832854.866148:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070464 00000100:00100000:3.0:1787832854.866222:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:3.0:1787832854.866234:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283070464:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787832854.866270:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787832854.866400:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283070464:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.866408:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 215 00000100:00100000:2.0:1787832854.867678:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565c72940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300880640:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787832854.872937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.873155:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070592 00000100:00100000:2.0:1787832854.873164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070592 00000100:00100000:2.0:1787832854.873217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:2.0:1787832854.873225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11621:x1874678283070592:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787832854.873294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873313:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873324:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873352:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873358:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873362:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873379:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873385:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873388:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832854.873421:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787832854.873424:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832854.873434:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873442:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873446:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873453:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873469:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.873474:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873482:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873495:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:2.0:1787832854.873498:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.873504:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873510:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ada lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873525:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873531:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873537:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873541:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.873543:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873549:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873566:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8c3547ea9600) 00010000:00010000:2.0:1787832854.873569:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.873572:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873578:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7ae1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873589:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873593:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873597:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873600:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610ae00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.873601:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873605:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873608:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832854.873610:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.873612:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.873617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b7ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832854.873756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11621:x1874678283070592:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 478us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.873762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 216 00000100:00100000:0.0:1787832854.881001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.881271:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070848 00000100:00100000:3.0:1787832854.881281:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070848 00000100:00100000:3.0:1787832854.881335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:3.0:1787832854.881344:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+60:11621:x1874678283070848:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832854.881369:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832854.881390:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7aef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a92 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881491:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881508:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881521:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832854.881533:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787832854.881627:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881635:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881642:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881647:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832854.881651:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881675:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881689:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832854.881692:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787832854.881697:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881743:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881783:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7aef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a92 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881794:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:3.0:1787832854.881796:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832854.881800:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7aef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a92 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.881809:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832854.881870:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283070848:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 527us (881us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787832854.881878:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 217 00000100:00100000:1.0:1787832854.884800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.884900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283070976 00000100:00100000:2.0:1787832854.884911:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283070976 00000100:00100000:2.0:1787832854.884980:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:2.0:1787832854.884990:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283070976:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787832854.885038:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787832854.885146:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283070976:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 156us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.885162:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 218 00000100:00100000:0.0:1787832854.890495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.890666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283071232 00000100:00100000:3.0:1787832854.890677:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283071232 00000100:00100000:3.0:1787832854.890771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:3.0:1787832854.890782:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283071232:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832854.890821:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832854.890824:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787832854.890857:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a76 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.890877:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:3.0:1787832854.890882:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832854.890896:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706a99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787832854.891576:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787832854.891838:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.891853:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.891862:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.891917:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a99 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.891936:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a99 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.891945:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832854.891947:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832854.891975:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832854.892061:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+62:11621:x1874678283071232:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1279us (1578us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787832854.892070:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 219 00000100:00100000:1.0:1787832854.905098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.905254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283071488 00000100:00100000:2.0:1787832854.905266:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283071488 00000100:00100000:2.0:1787832854.905332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:2.0:1787832854.905343:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+62:11621:x1874678283071488:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787832854.905415:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832854.905446:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87e00/0x72bd9178b14b7b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a99 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905467:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:2.0:1787832854.905481:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832854.905506:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905519:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905563:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905570:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905577:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905663:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905671:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.905678:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906285:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.906290:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906300:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906309:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:2.0:1787832854.906312:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.906317:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906335:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906349:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906355:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906361:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906366:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.906370:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906376:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906385:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa40c6235 (ffff8c3547ea9600) 00010000:00010000:2.0:1787832854.906387:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832854.906389:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.906395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7b20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa40c6235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832854.906495:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283071488:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1151us (1406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787832854.906502:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 220 00000100:00100000:2.0:1787832854.909501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.909628:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283071616 00000100:00100000:3.0:1787832854.909638:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283071616 00000100:00100000:3.0:1787832854.909729:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:3.0:1787832854.909740:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+61:11621:x1874678283071616:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832854.909761:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832854.909788:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706aa0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909825:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909838:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909848:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909965:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909984:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.909992:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:3.0:1787832854.909995:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787832854.910006:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87000, rc 0) 00000100:00100000:3.0:1787832854.910089:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+62:11621:x1874678283071616:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 350us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.910096:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 221 00000100:00100000:0.0:1787832854.915132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.916137:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283071872 00000100:00100000:3.0:1787832854.916162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283071872 00000100:00100000:3.0:1787832854.916231:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 222 00000100:00100000:3.0:1787832854.916242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+62:11621:x1874678283071872:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832854.916333:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.916350:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.916361:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832854.916653:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1787832854.916662:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377944959571ns, next at 378944957011ns, rc = 0 00000004:00010000:3.0:1787832854.916770:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045593c04 reply state 000000001040af82 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832854.916780:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832854.916899:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+64:11621:x1874678283071872:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 659us (1777us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787832854.916907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 222 00010000:00010000:2.0:1787832854.923399:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923416:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923425:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923432:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832854.923436:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923445:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923464:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:2.0:1787832854.923467:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787832854.923473:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.923479:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87c00/0x72bd9178b14b7b35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832854.943272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.943372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072000 00000100:00100000:3.0:1787832854.943382:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072000 00000100:00100000:3.0:1787832854.943448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:3.0:1787832854.943459:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+63:11621:x1874678283072000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832854.943506:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832854.943538:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706aa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.943658:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.943675:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832854.944304:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:3.0:1787832854.944309:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832854.944313:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832854.944457:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b808f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+64:11621:x1874678283072000:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 997us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.944466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 223 00000100:00100000:0.0:1787832854.950512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.950875:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072128 00000100:00100000:3.0:1787832854.950889:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072128 00000100:00100000:3.0:1787832854.950980:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:3.0:1787832854.950991:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283072128:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787832854.951599:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2352:x1874678283072128:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 607us (1098us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787832854.951608:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:0.0:1787832854.960716:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832854.961679:0:12588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072384 00000100:00100000:1.0:1787832854.961785:0:12588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072384 00000100:00100000:1.0:1787832854.961854:0:12588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:1.0:1787832854.961864:0:12588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+64:11621:x1874678283072384:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787832854.962136:0:12588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+65:11621:x1874678283072384:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 272us (1449us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787832854.962231:0:12588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1787832854.987286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832854.987396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072640 00000100:00100000:3.0:1787832854.987406:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072640 00000100:00100000:3.0:1787832854.987479:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:3.0:1787832854.987490:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+65:11621:x1874678283072640:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787832854.987649:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+65:11621:x1874678283072640:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832854.987658:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 224 00000100:00100000:3.0:1787832854.991421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832854.991674:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072768 00000100:00100000:2.0:1787832854.991693:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072768 00000100:00100000:2.0:1787832854.991775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:2.0:1787832854.991787:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+65:11621:x1874678283072768:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832854.991808:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832854.991845:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706aae expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.991926:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.991938:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.991948:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832854.991993:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832854.992014:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.992042:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aae expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.992061:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aae expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832854.992069:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:2.0:1787832854.992072:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787832854.992075:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a800, rc 0) 00000100:00100000:2.0:1787832854.992146:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+66:11621:x1874678283072768:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 361us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832854.992153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 225 00000100:00100000:0.0:1787832855.000516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.003189:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283072896 00000100:00100000:3.0:1787832855.003207:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283072896 00000100:00100000:3.0:1787832855.003295:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:3.0:1787832855.003308:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+10:2353:x1874678283072896:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832855.003329:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832855.003357:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706ab5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832855.003388:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902a17, blocks: 0x1 00010000:00010000:3.0:1787832855.003410:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1787832855.003416:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832855.003428:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.003449:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.003464:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832855.003552:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:2353:x1874678283072896:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 247us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832855.003561:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:0.0:1787832855.014269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.015065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073152 00000100:00100000:3.0:1787832855.015076:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073152 00000100:00100000:3.0:1787832855.015150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:3.0:1787832855.015161:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+66:11621:x1874678283073152:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787832855.015301:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+66:11621:x1874678283073152:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 142us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832855.015310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 226 00000100:00100000:1.0:1787832855.044093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.045163:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073280 00000100:00100000:0.0:1787832855.045176:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073280 00000100:00100000:0.0:1787832855.045264:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:0.0:1787832855.045277:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+11:11621:x1874678283073280:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832855.045301:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832855.045324:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706abc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.045358:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.045387:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832855.045391:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832855.045397:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.045453:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.045468:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832855.045482:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35660970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300880768:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832855.045601:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f05f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832855.058477:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35660970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874678300880768:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832855.058525:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.058567:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:2.0:1787832855.058641:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:11621:x1874678283073280:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 13366us (14559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832855.058651:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787832855.058913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832855.061852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073408 00000100:00100000:2.0:1787832855.061873:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073408 00010000:00010000:2.0:1787832855.061944:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.062010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1787832855.062021:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:2352:x1874678283073408:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832855.062038:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832855.062063:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.062079:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.062106:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7b51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ab5 expref: 12 pid: 6697 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.062124:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832855.062128:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832855.062138:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.062165:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.062208:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.062223:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1874678300880896:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787832855.062322:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832855.105562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.106514:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073536 00000100:00100000:0.0:1787832855.106526:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073536 00002000:00100000:0.0:1787832855.106585:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c357bb443c0 x1874678283073536/t0(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:416/0 lens 504/0 e 0 to 0 dl 1787832866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832855.106597:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357bb443c0 with x1874678283073536 ext(0->12) 00002000:00010000:0.0:1787832855.106614:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357bb443c0 00000100:00100000:0.0:1787832855.106646:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:0.0:1787832855.106655:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:2354:x1874678283073536:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787832855.107202:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2354:x1874678283073536:12345-192.168.201.34@tcp:4:lhsmtool_posix.0 Request processed in 546us (1650us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787832855.107219:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00002000:00100000:0.0:1787832855.107227:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c357bb443c0 x1874678283073536/t4294967321(0) o4->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:416/0 lens 504/448 e 0 to 0 dl 1787832866 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787832855.107235:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357bb443c0 with x1874678283073536 ext(0->12) 00002000:00010000:0.0:1787832855.107238:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357bb443c0 00000100:00100000:1.0:1787832855.109105:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb461c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1874678300880896:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787832855.109133:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832855.109204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2352:x1874678283073408:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 47184us (50291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832855.109216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:2.0:1787832855.114987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.115332:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073664 00000100:00100000:3.0:1787832855.115343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073664 00000100:00100000:3.0:1787832855.115410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 227 00000100:00100000:3.0:1787832855.115420:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+66:11621:x1874678283073664:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787832855.217093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+66:11621:x1874678283073664:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 101655us (102096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.217111:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 227 00000001:00080000:1.0:1787832855.217259:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:1.0:1787832855.217285:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1787832855.220371:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832855.220415:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300881024:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787832855.220667:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c3545211540 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:3.0:1787832855.220786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832855.220877:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300881024 00000100:00100000:3.0:1787832855.220886:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300881024 00000100:00100000:3.0:1787832855.220944:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787832855.220968:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300881024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787832855.221003:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787832855.221043:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a902a16, atime: 0x6a902a16, ctime: 0x6a902a16, blocks: 0x1 00010000:00010000:3.0:1787832855.221064:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.221085:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1787832855.221091:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832855.221100:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.221140:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.221317:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.221327:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.221355:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832855.221591:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832855.221601:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.221613:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832855.221675:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.221688:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.221744:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.221753:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001483a214/0x72bd9178b14b7b5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.222037:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832855.222040:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832855.222042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832855.222348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.222405:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073792 00000100:00100000:0.0:1787832855.222414:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073792 00000100:00100000:0.0:1787832855.223050:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1787832855.223066:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+13:2352:x1874678283073792:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000020:00080000:1.0:1787832855.223989:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357bb53600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c35452113c0 00000020:00080000:1.0:1787832855.223996:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357bb53e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3565dc2000 00000020:00080000:0.0:1787832855.224048:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787832855.224125:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300881024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3154us (3334us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787832855.224136:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000001:00080000:1.0:1787832855.224372:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787832855.224418:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787832855.224457:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787832855.224475:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c357af55240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787832855.224479:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b087000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c357af550c0 00000020:00080000:1.0:1787832855.224483:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b087700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3549768c00 00000020:00080000:1.0:1787832855.224755:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787832855.229898:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787832855.229938:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300881152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787832855.230203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832855.230273:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832855.230298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300881280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787832855.230327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787832855.230419:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c3566095680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787832855.230448:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300881024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787832855.230604:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300881152 00000100:00100000:2.0:1787832855.230613:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300881152 00000100:00100000:2.0:1787832855.230689:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300881280 00000100:00100000:2.0:1787832855.230693:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300881280 00000100:00100000:2.0:1787832855.230749:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787832855.230760:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874678300881152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787832855.230804:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787832855.230841:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.230868:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.230879:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787832855.230895:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832855.230901:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.230958:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.230976:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 13 pid: 6697 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.230992:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300881408:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832855.231087:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e180 going to sleep for 11 seconds 00000100:00080000:1.0:1787832855.232414:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832855.239462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832855.239502:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283073920 00000100:00100000:2.0:1787832855.239510:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283073920 00010000:00010000:2.0:1787832855.239554:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 14 pid: 6697 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.239590:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 82 00000100:00100000:2.0:1787832855.239596:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283073920:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832855.239612:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832855.239616:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 14 pid: 6697 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239628:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 14 pid: 6697 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239681:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832855.239685:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832855.239690:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239698:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239734:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832855.239798:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+14:2353:x1874678283073920:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 200us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832855.239808:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 82 00010000:00010000:2.0:1787832855.239875:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a1b expref: 13 pid: 6697 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.239894:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300881408:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832855.239919:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239931:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239938:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239972:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.239980:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.240007:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832855.240088:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832855.240103:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.240202:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832855.240501:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.240515:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.240538:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.240547:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d35bbd16/0x72bd9178b14b7b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.240593:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832855.240597:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832855.240599:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787832855.241290:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c357b6912c0/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787832855.241303:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300881152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787832855.242138:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1874678300881152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11374us (11930us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787832855.242153:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787832855.242313:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787832855.242324:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874678300881280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787832855.242532:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787832855.242535:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787832855 00002000:00010000:2.0:1787832855.242537:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787832855.242539:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787832855 -> 1787832855 00002000:00010000:2.0:1787832855.242541:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787832855.246635:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1874678300881280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4290us (16281us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787832855.246654:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1787832855.246734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787832855.249028:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c357b691a40/2, rc 0, transno 4294967323 00000100:00100000:1.0:1787832855.249048:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300881280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787832855.298726:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+12:2352:x1874678283073792:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 75630us (76349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.298744:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000001:00080000:3.0:1787832855.298856:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1787832855.298879:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1787832855.302930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.303029:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074176 00000100:00100000:3.0:1787832855.303041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074176 00000100:00100000:3.0:1787832855.303118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:3.0:1787832855.303129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11621:x1874678283074176:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832855.303205:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832855.303244:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b7b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aae expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.303268:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:3.0:1787832855.303274:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832855.303336:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.303353:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.303365:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832855.303679:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adb156e8 reply state 0000000073d3d2fd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.303690:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787832855.304544:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:11621:x1874678283074176:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1410us (1621us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787832855.304554:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 228 00000100:00100000:3.0:1787832855.308673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.308754:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074304 00000100:00100000:3.0:1787832855.308767:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074304 00000100:00100000:0.0:1787832855.309385:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 70 00000100:00100000:0.0:1787832855.309401:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283074304:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787832855.309670:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787832855.309674:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787832855 -> 1787832855 00002000:00010000:0.0:1787832855.309677:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787832854 00002000:00010000:0.0:1787832855.309679:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787832855 -> 1787832855 00002000:00010000:0.0:1787832855.309682:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787832855.309793:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283074304:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 396us (1134us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787832855.309820:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 70 00010000:00010000:2.0:1787832855.312557:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312578:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312609:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312625:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832855.312632:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312641:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312661:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:2.0:1787832855.312665:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832855.312670:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.312677:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87600/0x72bd9178b14b7b6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.313577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832855.313746:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074560 00000100:00100000:1.0:1787832855.313758:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074560 00000100:00100000:1.0:1787832855.313832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:1.0:1787832855.313843:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11621:x1874678283074560:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787832855.313923:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.313940:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.313961:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.314002:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.314026:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 20 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832855.314051:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b68da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300881536:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832855.314166:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66600 going to sleep for 11 seconds 00000100:00100000:3.0:1787832855.318240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832855.318372:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b68da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874678300881536:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832855.318409:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832855.318496:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074688 00000100:00100000:0.0:1787832855.318505:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074688 00010000:00010000:0.0:1787832855.318552:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832855.318598:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:0.0:1787832855.318609:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:2353:x1874678283074688:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832855.318628:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832855.318635:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318649:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318676:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87000/0x72bd9178b14b7b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa0 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318694:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:0.0:1787832855.318750:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318762:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318772:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.318837:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832855.318900:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2353:x1874678283074688:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 293us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.318909:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00010000:00010000:2.0:1787832855.319204:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319213:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319249:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319257:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319265:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319279:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832855.319285:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319294:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319305:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:2.0:1787832855.319308:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787832855.319313:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.319320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40c00/0x72bd9178b14b7b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.319384:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11621:x1874678283074560:12345-192.168.201.34@tcp:55:lhsmtool_posix.0 Request processed in 5542us (5815us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787832855.319393:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 229 00000100:00100000:3.0:1787832855.325328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832855.325429:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074816 00000100:00100000:2.0:1787832855.325442:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074816 00000100:00100000:2.0:1787832855.325521:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:2.0:1787832855.325532:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283074816:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787832855.325588:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.325614:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.325661:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832855.325666:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832855.325671:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.326511:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.326549:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 8 pid: 6696 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832855.326567:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b68da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300881664:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832855.326974:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356615e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787832855.331598:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.332393:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283074944 00000100:00100000:3.0:1787832855.332407:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283074944 00010000:00010000:3.0:1787832855.332460:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 9 pid: 6696 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.332517:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:3.0:1787832855.332528:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283074944:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787832855.332548:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832855.332577:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 9 pid: 6696 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.332628:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 9 pid: 6696 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.332663:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832855.332668:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787832855.332676:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.332698:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.332743:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832855.332818:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+9:2352:x1874678283074944:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 291us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832855.334367:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00010000:00010000:2.0:1787832855.334662:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf7e40e/0x72bd9178b14b7b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706abc expref: 8 pid: 6696 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.334687:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b68da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8408:1874678300881664:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832855.334751:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.334765:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.334773:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.334813:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.334959:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.334995:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.335004:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832855.335017:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.335028:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.335213:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.335223:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ca02110/0x72bd9178b14b7b7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.335379:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2352:x1874678283074816:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 9847us (10063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832855.335390:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 71 00000100:00100000:1.0:1787832855.340467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.340573:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283075200 00000100:00100000:3.0:1787832855.340586:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283075200 00000100:00100000:3.0:1787832855.340808:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 230 00000100:00100000:3.0:1787832855.341136:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11621:x1874678283075200:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787832855.341312:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.341335:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.341350:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.341980:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.342001:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.342206:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.342256:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.342276:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 20 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.342293:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300881792:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832855.342473:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832855.349315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.349503:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300881792:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832855.349538:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.349599:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283075328 00000100:00100000:2.0:1787832855.349608:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283075328 00010000:00010000:2.0:1787832855.350263:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.350370:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:2.0:1787832855.350400:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:2353:x1874678283075328:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832855.350420:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832855.350428:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350443:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350483:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86e00/0x72bd9178b14b7b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aa7 expref: 21 pid: 5845 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350503:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:2.0:1787832855.350508:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350519:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350527:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.350558:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832855.350652:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2353:x1874678283075328:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 255us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832855.350661:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00010000:00010000:3.0:1787832855.351075:0:10395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.351085:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832855.351343:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787832855.351530:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787832855.351580:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787832855.351691:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300881920:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832855.351811:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832855.352164:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832855.352210:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300881920 00000100:00100000:3.0:1787832855.352218:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300881920 00000100:00100000:3.0:1787832855.352270:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787832855.352279:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10395:x1874678300881920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832855.352391:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10395:x1874678300881920:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832855.352399:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787832855.352444:0:10395:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1787832855.352451:0:10395:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1787832855.352477:0:10395:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c357b6912c0 x1874678300881152/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787832871 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832855.352489:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300881920:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787832855.353348:0:10395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787832855.353439:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300882048:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832855.353497:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832855.353528:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832855.353544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300882048 00000100:00100000:3.0:1787832855.353550:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300882048 00000100:00100000:3.0:1787832855.353578:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787832855.353586:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10395:x1874678300882048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787832855.355517:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:10395:x1874678300882048:12345-0@lo:1000:mdt00_003.0 Request processed in 1027us (1116us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787832855.355554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787832855.357455:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10395:1874678300882048:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787832855.357530:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357542:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357550:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357557:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832855.357562:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357571:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357591:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543a9c400) 00010000:00010000:3.0:1787832855.357595:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832855.357601:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357608:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357774:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357782:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357807:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357812:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832855.357815:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357821:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.357831:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832855.357834:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832855.358232:0:10395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.358247:0:10395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.358258:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.358316:0:10395:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.358334:0:10395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300882176:192.168.201.34@tcp:105: 00000100:00100000:3.0:1787832855.358461:0:10395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787832855.373970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.374343:0:10395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10395:1874678300882176:192.168.201.34@tcp:105: 00010000:00010000:3.0:1787832855.374412:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374425:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7acc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374468:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374486:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374500:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374513:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374520:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374527:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374534:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832855.374538:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374545:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374558:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832855.374561:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832855.374572:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374579:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7b90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374590:0:10395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374596:0:10395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374603:0:10395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374608:0:10395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832855.374621:0:10395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374630:0:10395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374759:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832855.374763:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787832855.374766:0:10395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832855.374773:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7b82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832855.375634:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11621:x1874678283075200:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 34810us (35176us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787832855.376202:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283075456 00000100:00100000:1.0:1787832855.376213:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283075456 00000100:00100000:1.0:1787832855.376281:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832855.376292:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11620:x1874678283075456:12345-192.168.201.34@tcp:49:lfs.0 00000100:00100000:1.0:1787832855.376420:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+24:11620:x1874678283075456:12345-192.168.201.34@tcp:49:lfs.0 Request processed in 130us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832855.376429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:3.0:1787832855.376576:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 230 00000020:00080000:3.0:1787832855.376597:0:10395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787832855.383847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.384176:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283075712 00000100:00100000:0.0:1787832855.384190:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283075712 00000100:00100000:0.0:1787832855.384269:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:0.0:1787832855.384280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11620:x1874678283075712:12345-192.168.201.34@tcp:58:lfs.0 00000040:00080000:0.0:1787832855.384874:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787832855.384996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11620:x1874678283075712:12345-192.168.201.34@tcp:58:lfs.0 Request processed in 716us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.385007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 231 00000100:00100000:1.0:1787832855.385469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832855.385511:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283075968 00000100:00100000:1.0:1787832855.385517:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283075968 00000100:00100000:1.0:1787832855.385555:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:1.0:1787832855.385563:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:11621:x1874678283075968:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787832855.386305:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787832855.386429:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787832855.386484:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386517:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386531:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386542:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386548:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386555:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386582:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787832855.386674:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:11621:x1874678283075968:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1110us (1205us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787832855.386682:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000020:00080000:1.0:1787832855.386688:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787832855.386794:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832855.386802:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386810:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832855.386815:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386825:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386853:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3543c5aa00) 00010000:00010000:1.0:1787832855.386856:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787832855.386863:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386869:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40600/0x72bd9178b14b7b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.386889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832855.386891:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832855.386892:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787832855.390053:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787832855.390065:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787832855.390108:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787832855.390116:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787832855.390424:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b68cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300882304:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832855.390529:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542f66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832855.409888:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b68cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1874678300882304:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832855.415670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.415806:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283076096 00000100:00100000:0.0:1787832855.415819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283076096 00000100:00100000:0.0:1787832855.415893:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:0.0:1787832855.415904:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:11622:x1874678283076096:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787832855.415964:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787832855.416129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:11622:x1874678283076096:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 225us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.416138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 232 00000100:00100000:0.0:1787832855.435433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832855.435582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283076352 00000100:00100000:3.0:1787832855.435596:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283076352 00000100:00100000:2.0:1787832855.435795:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:2.0:1787832855.435810:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+25:11622:x1874678283076352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832855.435841:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832855.435890:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706ac3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.436053:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.436073:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.436088:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832855.436101:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787832855.436293:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7b9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ac3 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.436317:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ac3 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.436326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832855.436329:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787832855.436334:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a200, rc 0) 00000100:00100000:2.0:1787832855.436410:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:11622:x1874678283076352:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 603us (993us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787832855.436418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 233 00000100:00100000:1.0:1787832855.450658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.450866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283076480 00000100:00100000:0.0:1787832855.450880:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283076480 00000100:00100000:0.0:1787832855.450986:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:0.0:1787832855.450998:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+27:11624:x1874678283076480:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:0.0:1787832855.451031:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832855.451071:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706aca expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451281:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451299:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451314:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451331:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451339:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.451346:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.452865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.452891:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 28 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.452902:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.452980:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 28 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.452999:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 28 pid: 10395 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832855.453017:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300882432:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832855.453937:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3546524240 going to sleep for 11 seconds 00000100:00100000:1.0:1787832855.456674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832855.457203:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283076736 00000100:00100000:2.0:1787832855.457216:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283076736 00000100:00100000:2.0:1787832855.457302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 235 00000100:00100000:2.0:1787832855.457315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:11622:x1874678283076736:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787832855.457441:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457465:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457481:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457792:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457802:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457809:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457816:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832855.457821:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457831:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457848:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:2.0:1787832855.457851:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787832855.457856:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832855.457864:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b800/0x72bd9178b14b7bcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832855.458082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:11622:x1874678283076736:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 767us (1421us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787832855.458091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 235 00000040:00080000:1.0:1787832855.458846:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787832855.458854:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787832855.459577:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787832855.460491:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787832855.463352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.463624:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874678300882432:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832855.463655:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832855.463888:0:12588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283076992 00000100:00100000:1.0:1787832855.463896:0:12588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283076992 00000100:00100000:1.0:1787832855.463989:0:12588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1787832855.464020:0:12588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:6057:x1874678283076992:12345-192.168.201.34@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787832855.464509:0:12588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:6057:x1874678283076992:12345-192.168.201.34@tcp:35:ldlm_bl.0 Request processed in 490us (1166us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787832855.464516:0:12588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:1.0:1787832855.466877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832855.466932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832855.467171:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283077120 00000100:00100000:0.0:1787832855.467183:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283077120 00010000:00010000:0.0:1787832855.467239:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 31 pid: 10395 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832855.467287:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787832855.467299:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+31:2352:x1874678283077120:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832855.467318:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832855.467327:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 31 pid: 10395 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467342:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 31 pid: 10395 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467393:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86600/0x72bd9178b14b7abe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a84 expref: 31 pid: 10395 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467412:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832855.467418:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467429:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467438:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832855.467476:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832855.467542:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:2352:x1874678283077120:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 245us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832855.467551:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00010000:00010000:1.0:1787832855.468623:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468638:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832855.468752:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787832855.468759:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832855.468787:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468804:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468815:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468823:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468830:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468837:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832855.468842:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468866:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468881:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832855.468884:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832855.468890:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468897:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468915:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468922:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468928:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468934:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832855.468936:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468955:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468965:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3542b1ff00) 00010000:00010000:1.0:1787832855.468967:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832855.468971:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.468990:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.469325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b7bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aca expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.469345:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aca expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832855.469353:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832855.469356:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832855.469359:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:1.0:1787832855.469429:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:11624:x1874678283076480:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 18433us (18792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832855.469439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 234 00000100:00100000:2.0:1787832855.474447:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283077376 00000100:00100000:2.0:1787832855.474469:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283077376 00000100:00100000:2.0:1787832855.474598:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1787832855.474611:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+29:11622:x1874678283077376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787832855.475038:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:11622:x1874678283077376:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 428us (8103us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787832855.475057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00010000:00010000:1.0:1787832856.268054:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832856.331888:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832856.331913:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832856.331994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832856.332069:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300882560 00000100:00100000:3.0:1787832856.332075:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300882560 00000100:00100000:3.0:1787832856.332121:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787832856.332526:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874678300882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832856.332548:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787832856.332608:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874678300882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832856.332616:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787832856.332697:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300882560:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787832856.411119:0:12626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832856.411130:0:12626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832856.411181:0:12626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787832856.411188:0:12626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787832856.807431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832856.807511:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283077632 00000100:00100000:3.0:1787832856.807521:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283077632 00000100:00100000:3.0:1787832856.807602:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00080000:1.0:1787832856.807607:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832856.807613:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+30:11648:x1874678283077632:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832856.807639:0:10395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832856.807661:0:10395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706ad1 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.807817:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7bdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.807833:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.807878:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832856.807892:0:10395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787832856.808051:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b7bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad1 expref: 33 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.808068:0:10395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad1 expref: 32 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.808076:0:10395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:3.0:1787832856.808079:0:10395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787832856.808082:0:10395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832856.808159:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11648:x1874678283077632:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 548us (738us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787832856.808167:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 236 00000100:00100000:3.0:1787832856.822599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832856.822729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283077760 00000100:00100000:0.0:1787832856.822741:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283077760 00000100:00100000:0.0:1787832856.822807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:0.0:1787832856.822818:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11648:x1874678283077760:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787832856.822904:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.822933:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.822962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823001:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823008:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823014:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823019:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832856.823023:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823029:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823041:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:0.0:1787832856.823044:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832856.823048:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832856.823054:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b7beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832856.823129:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b691e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:11648:x1874678283077760:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 312us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832856.823137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 237 00000100:00100000:1.0:1787832856.844018:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300882816:0@lo:400:kworker.0 00000100:00100000:1.0:1787832856.844086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832856.844159:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832856.844165:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300882944:0@lo:400:kworker.0 00000100:00100000:1.0:1787832856.844184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832856.844218:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300882816 00000100:00100000:1.0:1787832856.844225:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300882816 00000100:00100000:1.0:1787832856.844263:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300882944 00000100:00100000:1.0:1787832856.844265:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300882944 00000100:00100000:1.0:1787832856.844288:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787832856.844302:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300882816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832856.844345:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300882816:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832856.844351:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787832856.844369:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787832856.844374:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300882944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832856.844394:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300882944:12345-0@lo:400:kworker.0 Request processed in 21us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832856.844399:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787832856.844416:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832856.844450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b7d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300882944:0@lo:400:kworker.0 00000100:00100000:1.0:1787832856.844460:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b7d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300882816:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844550:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b7d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300883072:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832856.844604:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787832856.844609:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b87de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300882688:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832856.844649:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b7d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300883200:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832856.844690:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300882688 00000100:00100000:2.0:1787832856.844694:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300882688 00000100:00100000:2.0:1787832856.844750:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787832856.844757:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300882688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844798:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300882688:12345-0@lo:400:kworker.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832856.844805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787832856.844832:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883200 00000100:00100000:2.0:1787832856.844836:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883200 00000100:00100000:2.0:1787832856.844866:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787832856.844873:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300883200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.844907:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300883200:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832856.844913:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787832856.844948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883072 00000100:00100000:2.0:1787832856.844951:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883072 00000100:00100000:2.0:1787832856.844971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787832856.844977:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300883072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.845006:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300883072:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832856.845012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787832856.845035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b87de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300882688:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.845046:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b7d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300883200:0@lo:400:kworker.0 00000100:00100000:2.0:1787832856.845053:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b7d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300883072:0@lo:400:kworker.0 00000100:00080000:1.0:1787832856.845124:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832856.845128:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787832856.845618:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832856.845627:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300883328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832856.845655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832856.845728:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883328 00000100:00100000:0.0:1787832856.845741:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883328 00000100:00100000:0.0:1787832856.845776:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787832856.845784:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300883328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832856.845811:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832856.845858:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b87de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300883328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832856.845876:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787832856.846076:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300883328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832856.983235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832856.983338:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283077888 00000100:00100000:3.0:1787832856.983350:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283077888 00000100:00100000:3.0:1787832856.983443:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00100000:3.0:1787832856.983454:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283077888:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1787832856.983472:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832856.983494:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7bf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706ad8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787832856.983521:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a902a17, atime: 0x6a902a16, ctime: 0x6a902a17, blocks: 0xb 00010000:00010000:3.0:1787832856.983556:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1787832856.983560:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832856.983570:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad8 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.983589:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7bf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad8 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832856.983603:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86800, rc 0) 00000100:00100000:3.0:1787832856.983665:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2354:x1874678283077888:12345-192.168.201.34@tcp:101:cat.0 Request processed in 213us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832856.983673:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 72 00000100:00080000:1.0:1787832856.983749:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832856.992682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832856.992825:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078016 00000100:00100000:1.0:1787832856.992835:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078016 00002000:00100000:1.0:1787832856.992902:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c357b692580 x1874678283078016/t0(0) o3->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:417/0 lens 488/0 e 0 to 0 dl 1787832867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832856.992913:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b692580 with x1874678283078016 ext(0->4095) 00002000:00010000:1.0:1787832856.992929:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b692580 00000100:00100000:1.0:1787832856.992962:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787832856.992972:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283078016:12345-192.168.201.34@tcp:3:cat.0 00000100:00100000:1.0:1787832856.993192:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2352:x1874678283078016:12345-192.168.201.34@tcp:3:cat.0 Request processed in 222us (521us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787832856.993204:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00002000:00100000:1.0:1787832856.993210:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c357b692580 x1874678283078016/t0(0) o3->fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436@192.168.201.34@tcp:417/0 lens 488/4536 e 0 to 0 dl 1787832867 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787832856.993215:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c357b692580 with x1874678283078016 ext(0->4095) 00002000:00010000:1.0:1787832856.993217:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c357b692580 00010000:00010000:2.0:1787832857.292353:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787832857.911645:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787832857.911670:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1787832857.911677:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1787832858.317011:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832859.137619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832859.137658:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832859.137692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832859.137752:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078528 00000100:00100000:2.0:1787832859.137763:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078528 00000100:00100000:2.0:1787832859.137830:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1787832859.137854:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283078528:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832859.137954:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283078528:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832859.137963:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1787832859.137987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078272 00000100:00100000:2.0:1787832859.137991:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078272 00000100:00100000:2.0:1787832859.138024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00100000:2.0:1787832859.138031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:2354:x1874678283078272:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832859.138063:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+32:2354:x1874678283078272:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832859.138070:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 171 00000100:00080000:2.0:1787832859.138927:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787832859.138945:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832859.140210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832859.140254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832859.140286:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078400 00000100:00100000:1.0:1787832859.140294:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078400 00000100:00100000:1.0:1787832859.140343:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832859.140353:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2354:x1874678283078400:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832859.140415:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+8:2354:x1874678283078400:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832859.140423:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832859.140445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078656 00000100:00100000:1.0:1787832859.140448:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078656 00000100:00100000:1.0:1787832859.140477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00100000:1.0:1787832859.140484:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283078656:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832859.140512:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283078656:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832859.140518:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 172 00000100:00080000:1.0:1787832859.140539:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787832859.140557:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832859.143437:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078144 00000100:00100000:2.0:1787832859.143453:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078144 00000100:00100000:1.0:1787832859.143541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 304 00000100:00100000:1.0:1787832859.143554:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283078144:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832859.143634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283078144:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 83us (5941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832859.143641:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 304 00010000:00010000:1.0:1787832859.348569:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832860.364097:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787832860.604043:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1787832860.604067:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1787832860.604090:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1787832860.604106:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787832860.604116:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c357af55180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787832860.604122:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b087b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c357af550c0 00000020:00080000:1.0:1787832860.604126:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c357b087400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3565d66800 00000020:00080000:1.0:1787832860.604151:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787832860.604380:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787832860.606499:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787832860.606523:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787832860.606533:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:1.0:1787832861.388118:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832861.452167:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832861.452193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300883456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832861.452266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.452562:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883456 00000100:00100000:3.0:1787832861.452570:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883456 00000100:00100000:3.0:1787832861.452635:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787832861.452645:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300883456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832861.452680:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787832861.452812:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832861.454881:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300883456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2228us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.454898:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787832861.470260:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1787832861.470272:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c357b6912c0, transno 4294967322 00000004:00080000:1.0:1787832861.470291:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c357b691a40, transno 4294967323 00000004:00080000:1.0:1787832861.470297:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1787832861.470920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300883456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832861.965128:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300883712:0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.965196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.965249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787832861.965254:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300883584:0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.965277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.966537:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300884096:0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.966591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.966644:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300883968:0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.966671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.966697:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787832861.966719:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300883840:0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.966740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832861.966826:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883712 00000100:00100000:3.0:1787832861.966843:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883712 00000100:00100000:3.0:1787832861.966889:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883968 00000100:00100000:3.0:1787832861.966892:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883968 00000100:00100000:3.0:1787832861.966916:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883840 00000100:00100000:3.0:1787832861.966918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883840 00000100:00100000:3.0:1787832861.966933:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787832861.966941:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300883712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.966998:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300883712:12345-0@lo:400:kworker.0 Request processed in 58us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.967004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787832861.967019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787832861.967025:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300883968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.967055:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300883968:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.967060:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787832861.967085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787832861.967092:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300883840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.967119:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300883840:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.967140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787832861.967160:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300883584 00000100:00100000:3.0:1787832861.967164:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300883584 00000100:00100000:3.0:1787832861.967190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787832861.967196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300883584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832861.967229:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3306:x1874678300883584:12345-0@lo:400:kworker.0 Request processed in 33us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.967235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787832861.967262:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884096 00000100:00100000:3.0:1787832861.967266:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884096 00000100:00100000:3.0:1787832861.967294:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787832861.967301:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300884096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787832861.968723:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832861.968728:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832861.968789:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300883840:0@lo:400:kworker.0 00000100:00100000:0.0:1787832861.968803:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300883968:0@lo:400:kworker.0 00000100:00100000:0.0:1787832861.968846:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300884224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832861.968890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832861.968921:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566158b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300883584:0@lo:400:kworker.0 00000100:00100000:0.0:1787832861.968934:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300883712:0@lo:400:kworker.0 00000100:00100000:0.0:1787832861.968981:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884224 00000100:00100000:0.0:1787832861.968986:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884224 00000100:00100000:0.0:1787832861.969017:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787832861.969025:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300884224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832861.969585:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300884096:12345-0@lo:400:kworker.0 Request processed in 2283us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832861.969595:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00000024:0.0:1787832861.970648:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832861.970721:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300884224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1678us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832861.970743:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787832861.980593:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787832861.980622:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787832861.980646:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c3566095680, transno 4294967310 00000100:00100000:1.0:1787832861.980675:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300884096:0@lo:400:kworker.0 00000100:00100000:1.0:1787832861.980740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3542f6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300884224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787832862.411946:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832863.440889:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832864.009656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832864.010026:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283078784 00000100:00100000:3.0:1787832864.010037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283078784 00000100:00100000:3.0:1787832864.010121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00100000:3.0:1787832864.010132:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11300:x1874678283078784:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787832864.010257:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11300:x1874678283078784:12345-192.168.201.34@tcp:60:lhsmtool_posix.0 Request processed in 127us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832864.010265:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 238 00000100:00080000:0.0:1787832864.010585:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832864.027657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832864.027819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079040 00000100:00100000:1.0:1787832864.027829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079040 00000100:00100000:1.0:1787832864.027887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:1.0:1787832864.027897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:11300:x1874678283079040:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787832864.028695:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:11300:x1874678283079040:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 796us (1045us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787832864.028735:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 65 00000100:00100000:2.0:1787832864.250148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832864.250198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832864.250264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832864.250294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832864.250321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832864.250355:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079424 00000100:00100000:2.0:1787832864.250363:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079424 00000100:00100000:2.0:1787832864.250425:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079552 00000100:00100000:2.0:1787832864.250428:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079552 00000100:00100000:2.0:1787832864.250450:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1787832864.250458:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283079424:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832864.250528:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2354:x1874678283079424:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832864.250536:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 63 00000100:00100000:2.0:1787832864.250553:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:2.0:1787832864.250559:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283079552:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832864.250582:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283079552:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832864.250588:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 64 00000100:00100000:1.0:1787832864.251270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079168 00000100:00100000:1.0:1787832864.251277:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079168 00000100:00100000:1.0:1787832864.251325:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 306 00000100:00100000:1.0:1787832864.251333:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283079168:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832864.251386:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2354:x1874678283079168:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 43us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832864.251393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 306 00000100:00100000:0.0:1787832864.251531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079680 00000100:00100000:0.0:1787832864.251536:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079680 00000100:00100000:0.0:1787832864.251582:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079296 00000100:00100000:0.0:1787832864.251586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079296 00000100:00100000:0.0:1787832864.251612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:0.0:1787832864.251619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283079680:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832864.251655:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:2354:x1874678283079680:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 36us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832864.251661:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 176 00000100:00100000:0.0:1787832864.251676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00100000:0.0:1787832864.251683:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2354:x1874678283079296:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832864.251751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:2354:x1874678283079296:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 69us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832864.251758:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 177 00000100:00080000:0.0:1787832864.251784:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787832864.251803:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832864.251805:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832864.405540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832864.405694:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079808 00000100:00100000:0.0:1787832864.405736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079808 00000100:00100000:0.0:1787832864.405847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 239 00000100:00100000:0.0:1787832864.405858:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+5:12101:x1874678283079808:12345-192.168.201.34@tcp:101:lsof.0 00010000:00010000:0.0:1787832864.406005:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832864.406078:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706adf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406170:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406186:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406199:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832864.406408:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787832864.406413:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832864.406495:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406524:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b7bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706adf expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406542:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706adf expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832864.406557:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:0.0:1787832864.406560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832864.406563:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:0.0:1787832864.406925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:12101:x1874678283079808:12345-192.168.201.34@tcp:101:lsof.0 Request processed in 1067us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832864.406933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 239 00010000:00010000:1.0:1787832864.460143:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832865.486168:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787832865.669936:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787832865.669957:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787832865.670219:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787832865.670236:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787832865.740069:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787832865.740083:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832865.740471:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787832865.740480:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787832866.512125:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832866.572337:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832866.572372:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300884352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832866.572494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832866.572690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884352 00000100:00100000:3.0:1787832866.572739:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884352 00000100:00100000:3.0:1787832866.572834:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787832866.572846:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300884352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832866.572897:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832866.573119:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300884352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832866.573128:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787832866.573263:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300884352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787832866.573455:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832867.085086:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300884480:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085294:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300884992:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085343:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832867.085349:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300884864:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085402:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300884608:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085441:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300885120:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085475:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832867.085479:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300884736:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832867.085528:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884864 00000100:00100000:1.0:1787832867.085535:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884864 00000100:00100000:1.0:1787832867.085576:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885120 00000100:00100000:1.0:1787832867.085579:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885120 00000100:00100000:1.0:1787832867.085610:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787832867.085619:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300884864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.085668:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300884864:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832867.085676:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787832867.085692:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787832867.085698:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300885120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.085979:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884992 00000100:00100000:0.0:1787832867.085984:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884992 00000100:00100000:0.0:1787832867.086011:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884608 00000100:00100000:0.0:1787832867.086014:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884608 00000100:00100000:0.0:1787832867.086024:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884736 00000100:00100000:0.0:1787832867.086026:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884736 00000100:00100000:0.0:1787832867.086039:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787832867.086045:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300884992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832867.087911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300884480 00000100:00100000:3.0:1787832867.087925:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300884480 00000100:00100000:3.0:1787832867.087989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787832867.087998:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.096310:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300884992:12345-0@lo:400:kworker.0 Request processed in 10254us (10975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832867.096331:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787832867.096372:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787832867.096386:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.096445:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300884608:12345-0@lo:400:kworker.0 Request processed in 66us (11021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832867.096451:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787832867.096461:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787832867.096469:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300884736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.096499:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300884736:12345-0@lo:400:kworker.0 Request processed in 32us (11000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832867.096506:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787832867.096693:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832867.096771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832867.096815:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885248 00000100:00100000:0.0:1787832867.096823:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885248 00000100:00100000:0.0:1787832867.096872:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787832867.096879:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566158b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300885248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832867.096913:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832867.096963:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566158b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300885248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832867.096971:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787832867.097017:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832867.097057:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300884736:0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.097068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300884608:0@lo:400:kworker.0 00000100:00080000:0.0:1787832867.097205:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787832867.097211:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832867.097386:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300884864:0@lo:400:kworker.0 00000100:00100000:0.0:1787832867.097399:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300884992:0@lo:400:kworker.0 00000100:00100000:1.0:1787832867.104202:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300885120:12345-0@lo:400:kworker.0 Request processed in 18495us (18733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832867.104235:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787832867.104492:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300885120:0@lo:400:kworker.0 00000100:00100000:3.0:1787832867.114242:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300884480:12345-0@lo:400:kworker.0 Request processed in 26236us (29013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832867.114255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787832867.114927:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300884480:0@lo:400:kworker.0 00000001:02000400:0.0:1787832867.251058:0:12830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:14:26 (1787832866) 00010000:00010000:2.0:1787832867.533682:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832868.557980:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832869.382202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832869.382252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832869.382295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832869.382322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832869.382351:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283079936 00000100:00100000:1.0:1787832869.382359:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283079936 00000100:00100000:1.0:1787832869.382411:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 308 00000100:00100000:1.0:1787832869.382421:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678283079936:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832869.382488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678283079936:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832869.382496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 308 00000100:00100000:0.0:1787832869.382770:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080064 00000100:00100000:0.0:1787832869.382776:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080064 00000100:00100000:0.0:1787832869.382821:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080448 00000100:00100000:0.0:1787832869.382824:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080448 00000100:00100000:0.0:1787832869.382845:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1787832869.382852:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2354:x1874678283080064:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832869.382892:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:2354:x1874678283080064:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832869.382913:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 181 00000100:00100000:0.0:1787832869.382926:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:0.0:1787832869.382932:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2355:x1874678283080448:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832869.382957:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2355:x1874678283080448:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832869.382963:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 182 00000100:00100000:0.0:1787832869.382982:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080192 00000100:00100000:0.0:1787832869.382985:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080192 00000100:00100000:0.0:1787832869.383012:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1787832869.383019:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2355:x1874678283080192:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832869.383045:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2355:x1874678283080192:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832869.383051:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00080000:1.0:1787832869.386766:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787832869.386777:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832869.394473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832869.394549:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080320 00000100:00100000:3.0:1787832869.394558:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080320 00000100:00100000:3.0:1787832869.394631:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:3.0:1787832869.394642:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283080320:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832869.394737:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2354:x1874678283080320:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 97us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832869.394745:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00080000:1.0:1787832869.394902:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787832869.584591:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832870.604370:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832871.628018:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832871.699335:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832871.699361:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300885376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832871.699449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832871.699744:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885376 00000100:00100000:2.0:1787832871.699752:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885376 00000100:00100000:2.0:1787832871.699820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787832871.699830:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300885376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787832871.699872:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787832871.699927:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300885376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832871.699934:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787832871.700006:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832871.701786:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300885376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832871.728235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832871.728425:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080704 00000100:00100000:1.0:1787832871.728440:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080704 00000100:00100000:1.0:1787832871.728542:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:1.0:1787832871.728556:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+19:12323:x1874678283080704:12345-192.168.201.34@tcp:35:umount.0 00000100:00080000:0.0:1787832871.731022:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832871.733895:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:12323:x1874678283080704:12345-192.168.201.34@tcp:35:umount.0 Request processed in 5329us (5662us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787832871.736179:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 66 00000100:00100000:3.0:1787832871.750966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832871.754642:0:12588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283080960 00000100:00100000:2.0:1787832871.754672:0:12588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283080960 00000100:00100000:2.0:1787832871.754800:0:12588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:2.0:1787832871.754814:0:12588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+20:12323:x1874678283080960:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:2.0:1787832871.755335:0:12588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:12323:x1874678283080960:12345-192.168.201.34@tcp:35:umount.0 Request processed in 518us (4380us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787832871.755349:0:12588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 67 00000100:00100000:0.0:1787832871.765491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832871.765685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081216 00000100:00100000:1.0:1787832871.765773:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081216 00000100:00100000:1.0:1787832871.765868:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:1.0:1787832871.765881:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356af25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+21:12323:x1874678283081216:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:0.0:1787832871.767570:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356af25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:12323:x1874678283081216:12345-192.168.201.34@tcp:35:umount.0 Request processed in 1680us (2083us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787832871.767584:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 68 00000100:00100000:0.0:1787832871.771343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832871.771480:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081472 00000100:00100000:3.0:1787832871.771493:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081472 00000100:00100000:3.0:1787832871.771615:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1787832871.771627:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:12323:x1874678283081472:12345-192.168.201.34@tcp:35:umount.0 00000100:00100000:3.0:1787832871.772691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b8452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:12323:x1874678283081472:12345-192.168.201.34@tcp:35:umount.0 Request processed in 1060us (1357us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787832871.772743:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 69 00000100:00100000:3.0:1787832871.780196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832871.780300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832871.791151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832871.795287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081728 00000100:00100000:2.0:1787832871.795305:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081728 00000100:00100000:2.0:1787832871.795463:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081600 00000100:00100000:2.0:1787832871.795468:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081600 00000100:00100000:0.0:1787832871.804027:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081984 00000100:00100000:0.0:1787832871.804041:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081984 00000100:00100000:0.0:1787832871.804097:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832871.804108:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357383b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+15:2355:x1874678283081728:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832871.804125:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832871.804146:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40200/0x72bd9178b14b6bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706632 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832871.804163:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832871.804289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832871.804301:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+14:2355:x1874678283081600:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832871.804310:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832871.804321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b6c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70666a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.804332:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832871.804943:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357383b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+13:2355:x1874678283081728:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 835us (24758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832871.804952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832871.805007:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832871.805015:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:2355:x1874678283081984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832871.805024:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832871.805037:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d200/0x72bd9178b14b6e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706735 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832871.805047:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832871.805068:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:2355:x1874678283081984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 54us (13930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832871.805075:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:3.0:1787832871.805160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832871.805943:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283081856 00000100:00100000:0.0:1787832871.805951:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283081856 00000100:00100000:0.0:1787832871.806011:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 73 00000100:00100000:0.0:1787832871.806019:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2351:x1874678283081856:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:0.0:1787832871.806042:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6f50 00000100:00080000:0.0:1787832871.806067:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c354828d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787832871.806107:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787832871.806410:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+2:2351:x1874678283081856:12345-192.168.201.34@tcp:9:umount.0 Request processed in 391us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832871.806418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 73 00010000:00010000:0.0:1787832871.807217:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787832871.807420:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832871.816429:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678283081600:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 12117us (36115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832871.816445:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:3.0:1787832871.820062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832871.820635:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283082368 00000100:00100000:0.0:1787832871.820646:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283082368 00000100:00100000:0.0:1787832871.820757:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 74 00000100:00100000:0.0:1787832871.820767:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+7:2351:x1874678283082368:12345-192.168.201.34@tcp:9:umount.0 00000020:00000080:0.0:1787832871.820797:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b71b8 00000020:00010000:0.0:1787832871.820804:0:6696:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c3550cf8800: total 0 00000100:00080000:0.0:1787832871.820809:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3550cfa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787832871.820848:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787832871.821148:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+5:2351:x1874678283082368:12345-192.168.201.34@tcp:9:umount.0 Request processed in 381us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832871.821155:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 74 00000020:00010000:0.0:1787832871.821294:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c3550cf8800: total 0 00010000:00010000:0.0:1787832871.821318:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c3550cf8800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787832871.821371:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7bf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad8 expref: 4 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832871.821409:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7554 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70690a expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832871.821425:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c3550cf8800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787832871.821439:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832871.821457:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832871.821459:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787832871.823453:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832871.845056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832871.845333:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283083392 00000100:00100000:0.0:1787832871.845343:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283083392 00000100:00100000:0.0:1787832871.845413:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 240 00000100:00100000:0.0:1787832871.845423:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+23:2351:x1874678283083392:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:0.0:1787832871.845458:0:10395:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bec 00000020:00010000:0.0:1787832871.845477:0:10395:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c3566176800: total 0 00000100:00080000:0.0:1787832871.845483:0:10395:0:(import.c:65:import_set_state_nolock()) ffff8c3566177000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787832871.845526:0:10395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787832871.846218:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436+22:2351:x1874678283083392:12345-192.168.201.34@tcp:39:umount.0 Request processed in 794us (1170us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787832871.846228:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 240 00000020:00010000:1.0:1787832871.846833:0:7636:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c3566176800: total 0 00010000:00010000:1.0:1787832871.846887:0:7636:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c3566176800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1787832871.846963:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832871.846967:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832871.846976:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031c00/0x72bd9178b14b7bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706aca expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.846996:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832871.846999:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787832871.847004:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b7ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ac3 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847031:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:1.0:1787832871.847034:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832871.847053:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c400/0x72bd9178b14b75b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706926 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847070:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3547ea9e00) 00010000:00010000:1.0:1787832871.847073:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832871.847077:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74d000/0x72bd9178b14b6ed2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70674a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847095:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832871.847097:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832871.847101:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc87800/0x72bd9178b14b7515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068f5 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847114:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832871.847116:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787832871.847120:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b753f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706903 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847135:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832871.847137:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787832871.847141:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b7bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ad1 expref: 15 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847150:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3547ea9d00) 00010000:00010000:1.0:1787832871.847153:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832871.847157:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74ce00/0x72bd9178b14b6eb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706743 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847172:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832871.847180:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787832871.847185:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74dc00/0x72bd9178b14b75d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70692d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847200:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c3547ea9a00) 00010000:00010000:1.0:1787832871.847202:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832871.847205:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b78b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7069ff expref: 12 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847220:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3543c5ac00) 00010000:00010000:1.0:1787832871.847222:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832871.847225:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74c600/0x72bd9178b14b7435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7068bd expref: 11 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847238:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832871.847241:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787832871.847245:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031e00/0x72bd9178b14b6f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70675f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847257:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c3542b1fc00) 00010000:00010000:1.0:1787832871.847259:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832871.847262:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b400/0x72bd9178b14b7ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706a8b expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847275:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3542b1f500) 00010000:00010000:1.0:1787832871.847278:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787832871.847282:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c354b74da00/0x72bd9178b14b7213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706831 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832871.847308:0:7636:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c3566176800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787832871.847322:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832871.847324:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832871.847325:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832872.204060:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b845e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300885504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832872.204176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832872.204265:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300885632:0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.204342:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300885888:0@lo:400:kworker.0 00000100:00100000:2.0:1787832872.204356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832872.204408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832872.204425:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787832872.204438:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300885760:0@lo:400:kworker.0 00000100:00100000:2.0:1787832872.204599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832872.204646:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885504 00000100:00100000:2.0:1787832872.204664:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885504 00000100:00100000:2.0:1787832872.204755:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787832872.204768:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b7d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300885504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832872.204778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885888 00000100:00100000:0.0:1787832872.204787:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885888 00002000:00000024:2.0:1787832872.204811:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832872.204906:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885760 00000100:00100000:0.0:1787832872.204912:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885760 00000100:00100000:0.0:1787832872.204943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787832872.204952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b847840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.205013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b847840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300885888:12345-0@lo:400:kworker.0 Request processed in 61us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832872.205021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787832872.205041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787832872.205048:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300885760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.205087:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300885760:12345-0@lo:400:kworker.0 Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832872.205106:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787832872.205156:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300885888:0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.205223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300885760:0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.205254:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300885632 00000100:00100000:0.0:1787832872.205258:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300885632 00000100:00100000:0.0:1787832872.205290:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787832872.205297:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300885632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.205353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3305:x1874678300885632:12345-0@lo:400:kworker.0 Request processed in 57us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832872.205360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:0.0:1787832872.205387:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787832872.205393:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832872.205410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300885632:0@lo:400:kworker.0 00000100:00100000:3.0:1787832872.206979:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832872.207001:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300886144:0@lo:400:kworker.0 00000100:00100000:3.0:1787832872.207058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832872.207103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886144 00000100:00100000:3.0:1787832872.207109:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886144 00000100:00100000:3.0:1787832872.207167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787832872.207176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300886144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832872.207224:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874678300886144:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832872.210097:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787832872.210193:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300886144:0@lo:400:kworker.0 00000100:00080000:3.0:1787832872.210223:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832872.210831:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832872.210872:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300886016:0@lo:400:kworker.0 00000100:00100000:0.0:1787832872.210976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832872.211784:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886016 00000100:00100000:3.0:1787832872.211796:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886016 00000100:00100000:3.0:1787832872.211868:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787832872.211877:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b844b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300886016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832872.211993:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b844b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300886016:12345-0@lo:400:kworker.0 Request processed in 117us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832872.212001:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787832872.212046:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300886016:0@lo:400:kworker.0 00000100:00100000:2.0:1787832872.215467:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b7d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300885504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10692us (11282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832872.215481:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787832872.221210:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b845e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300885504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787832872.652084:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787832873.319313:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:3.0:1787832873.319327:0:7648:0:(genops.c:885:class_export_put()) final put ffff8c354828b800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:2.0:1787832873.319423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c354828b800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-OST0001 00000020:00000080:2.0:1787832873.319491:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c354828d800 for lustre-OST0001 00010000:00010000:0.0:1787832873.676112:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832874.410889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832874.410946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832874.410990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832874.411032:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283083648 00000100:00100000:0.0:1787832874.411047:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283083648 00000100:00100000:0.0:1787832874.411123:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283083904 00000100:00100000:0.0:1787832874.411126:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283083904 00000100:00100000:0.0:1787832874.411140:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283083776 00000100:00100000:0.0:1787832874.411161:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283083776 00000100:00100000:0.0:1787832874.411184:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787832874.411195:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b847c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:2355:x1874678283083648:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832874.411217:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787832874.411644:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1787832874.411658:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b845e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+12:2355:x1874678283083904:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832874.411670:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832874.411683:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b6e5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70672e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832874.411751:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832874.411841:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b845e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+11:2355:x1874678283083904:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 187us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832874.411851:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1787832874.411877:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787832874.411886:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+10:2355:x1874678283083776:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832874.411896:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832874.411906:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031400/0x72bd9178b14b6cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b7066a9 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832874.411916:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832874.411948:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+9:2355:x1874678283083776:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 65us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832874.411955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00010000:00010000:0.0:1787832874.412120:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad41800/0x72bd9178b14b6cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b70667f expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832874.412132:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832874.412242:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b847c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+7:2355:x1874678283083648:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 1037us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832874.412252:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787832874.414548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832874.414658:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084032 00000100:00100000:0.0:1787832874.414670:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084032 00000100:00100000:0.0:1787832874.414804:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00100000:0.0:1787832874.415068:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+6:2351:x1874678283084032:12345-192.168.201.34@tcp:39:umount.0 00000020:00000080:0.0:1787832874.415136:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6cd3 00000020:00010000:0.0:1787832874.415147:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c357c692800: total 0 00000100:00080000:0.0:1787832874.415152:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8c357c691800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787832874.415190:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787832874.416039:0:7636:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c357c692800: total 0 00010000:00010000:1.0:1787832874.416047:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832874.416107:0:7636:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c357c692800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787832874.416153:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9100) 00010000:00010000:1.0:1787832874.416158:0:7636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832874.416170:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b7c00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706adf expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832874.416208:0:7636:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c357c692800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787832874.416219:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832874.416221:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832874.416222:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832874.416520:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f665ede-f2c4-41f1-a7ce-59cc3155785a+3:2351:x1874678283084032:12345-192.168.201.34@tcp:39:umount.0 Request processed in 1703us (1982us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787832874.416533:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 241 00000100:00080000:3.0:1787832874.417250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832874.442066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832874.442193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084288 00000100:00100000:1.0:1787832874.442208:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084288 00000100:00100000:1.0:1787832874.442278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 310 00000100:00100000:1.0:1787832874.442291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+7:2351:x1874678283084288:12345-192.168.201.34@tcp:251:umount.0 00000020:00000080:1.0:1787832874.442352:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bc9 00000020:00010000:1.0:1787832874.442363:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c357bb22000: total 0 00000100:00080000:1.0:1787832874.442369:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8c357bb22800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787832874.442471:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35436d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fcfcf5f-6ec9-48b8-bf3c-549401e30d94+3:2351:x1874678283084288:12345-192.168.201.34@tcp:251:umount.0 Request processed in 184us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832874.442479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 310 00000020:00010000:2.0:1787832874.444227:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c357bb22000: total 0 00010000:00010000:2.0:1787832874.444305:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c357bb22000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787832874.444354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad41600/0x72bd9178b14b6c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706671 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832874.444378:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c357bb22000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787832874.444389:0:5833:0:(genops.c:885:class_export_put()) final put ffff8c357bb22000/5fcfcf5f-6ec9-48b8-bf3c-549401e30d94 00010000:00010000:2.0:1787832874.444414:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832874.444417:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832874.444419:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787832874.444558:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357bb22000/5fcfcf5f-6ec9-48b8-bf3c-549401e30d94 for MGS 00000020:00000080:3.0:1787832874.444630:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357bb22800 for MGS 00010000:00010000:3.0:1787832874.700126:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.729198:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787832875.866817:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000001:00080000:1.0:1787832875.866841:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787832875.866856:0:5867:0:(genops.c:885:class_export_put()) final put ffff8c357c692800/2f665ede-f2c4-41f1-a7ce-59cc3155785a 00000001:00100000:1.0:1787832875.866877:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000001:00080000:1.0:1787832875.866883:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787832875.866901:0:5867:0:(genops.c:885:class_export_put()) final put ffff8c3566176800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832875.866917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c692800/2f665ede-f2c4-41f1-a7ce-59cc3155785a for lustre-MDT0000 00000020:00000080:1.0:1787832875.866973:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566176800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-MDT0000 00000020:00000080:1.0:1787832875.867007:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357c691800 for lustre-MDT0000 00000020:00000080:1.0:1787832875.867012:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3566177000 for lustre-MDT0000 00000001:00100000:1.0:1787832875.886444:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832875.886452:0:6720:0:(genops.c:885:class_export_put()) final put ffff8c3550cf8800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 00000020:00000080:1.0:1787832875.886491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3550cf8800/fcaf5bfa-a1f5-4cd0-9dfa-a9d516597436 for lustre-OST0000 00000020:00000080:1.0:1787832875.886681:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3550cfa800 for lustre-OST0000 00000020:01000004:1.0:1787832875.905802:0:13032:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787832875.924046:0:13032:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787832875.924115:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.924132:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.924140:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.924147:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.924173:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787832875.924179:0:13032:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787832875.924201:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787832875.924218:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787832875.924224:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787832875.924250:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c357c6d6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787832875.924396:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300886272:0@lo:39:umount.0 00000100:00100000:0.0:1787832875.924471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832875.924847:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886272 00000100:00100000:1.0:1787832875.924855:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886272 00000100:00100000:1.0:1787832875.924899:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787832875.924909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874678300886272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787832875.924941:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b69d8 00000100:00080000:1.0:1787832875.924950:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8c3565115000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787832875.925032:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b68f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1874678300886272:12345-0@lo:39:umount.0 Request processed in 124us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.925040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787832875.925050:0:5844:0:(genops.c:885:class_export_put()) final put ffff8c3565117800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787832875.925075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3565117800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787832875.925143:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3565115000 for lustre-MDT0000 00000100:00080000:1.0:1787832875.925178:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357c6d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787832875.925187:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300886272:0@lo:39:umount.0 00000100:00080000:1.0:1787832875.925209:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787832875.925212:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787832875.925215:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787832875.925937:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832875.925954:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.925968:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832875.925973:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.926008:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832875.926017:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832875.926023:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787832875.926027:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787832875.926031:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787832875.926081:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.926088:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787832875.926122:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.926130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215d400/0x72bd9178b14b6c5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c63 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.926147:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832875.926150:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832875.926152:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.926322:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926336:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926344:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926367:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926392:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832875.926398:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926404:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926411:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926418:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926433:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787832875.926445:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787832875.926450:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926456:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215de00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832875.926460:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926468:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832875.926476:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832875.926487:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787832875.926489:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787832875.926516:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926521:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832875.926540:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926548:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215de00/0x72bd9178b14b6c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c71 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926561:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832875.926564:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926569:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832875.926572:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926579:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832875.926599:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832875.926604:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787832875.926606:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787832875.926609:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787832875.926626:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926632:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832875.926638:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5e00/0x72bd9178b14b6b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6b8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.926655:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.926657:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.926658:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832875.926672:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300886656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832875.926740:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832875.926757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832875.926799:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832875.926805:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300886528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832875.926829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832875.926864:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886656 00000100:00100000:1.0:1787832875.926869:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886656 00000100:00100000:1.0:1787832875.926921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886528 00000100:00100000:1.0:1787832875.926924:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886528 00000100:00100000:2.0:1787832875.926938:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832875.926965:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3308:x1874678300886656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832875.926987:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832875.927015:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215c200/0x72bd9178b14b6b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6b83 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832875.927053:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832875.927059:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832875.927077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300886400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832875.927124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832875.927175:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886400 00000100:00100000:3.0:1787832875.927180:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886400 00000100:00100000:2.0:1787832875.927220:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3308:x1874678300886656:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.929429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832875.929450:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3573838050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+20:3308:x1874678300886528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832875.929469:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832875.929492:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b6c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c6a expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929510:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832875.929780:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3573838050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:204f2893-acc1-48f1-8f52-36a94d59ea17+19:3308:x1874678300886528:12345-0@lo:103:ldlm_bl.0 Request processed in 338us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.929799:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787832875.929844:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929855:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929863:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929870:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929892:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832875.929903:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832875.929909:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929916:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74de00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832875.929921:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929930:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832875.929937:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832875.929943:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787832875.929952:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787832875.929954:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787832875.929981:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.929989:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832875.930018:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.930026:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74de00/0x72bd9178b14b6e7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6e85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.930043:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.930047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.930049:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832875.930061:0:13032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.930070:0:13032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832875.930075:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300886656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832875.930081:0:13032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.930093:0:13032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832875.930122:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300886528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832875.930199:0:13032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787832875.930205:0:13032:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787832875.930210:0:13032:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787832875.930243:0:13032:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787832875.930247:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787832875.930258:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787832875.930265:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787832875.930272:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c357bb20000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787832875.930281:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c357b9ed000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1787832875.930284:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1787832875.930288:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c356619b370) has exports, disconnecting them 00010000:00010000:0.0:1787832875.930294:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787832875.930298:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c357bb20000), last request at 1787832872 00000020:00000080:1.0:1787832875.930310:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6b4b 00010000:00010000:0.0:1787832875.930332:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74c200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832875.930337:0:7636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832875.930346:0:7636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832875.930354:0:7636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832875.930360:0:7636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787832875.930362:0:7636:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787832875.930365:0:7636:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1787832875.930398:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787832875.930403:0:7636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832875.930412:0:7636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832875.930426:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832875.930447:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74c200/0x72bd9178b14b6937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b693e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787832875.930450:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c357bb20000): rc 0 00000020:00000080:1.0:1787832875.930459:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357bb20000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787832875.930473:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c357b9ed000), last request at 1787832872 00000020:00000080:1.0:1787832875.930480:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6a80 00000100:00080000:1.0:1787832875.930492:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ec800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787832875.930498:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832875.930503:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832875.930508:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787832875.930510:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357bb20000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1787832875.930781:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c357b9ed000): rc 0 00000020:00000080:0.0:1787832875.930797:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357b9ed000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787832875.930819:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357bb26000 for lustre-MDT0000 00000020:00000080:1.0:1787832875.930827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357b9ed000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787832875.930848:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357b9ec800 for lustre-MDT0000 00010000:00010000:1.0:1787832875.930862:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832875.931618:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787832875.931638:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3306:x1874678300886400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832875.931655:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832875.931674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74ca00/0x72bd9178b14b6c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c5c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832875.931690:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832875.931761:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:3306:x1874678300886400:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832875.931769:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787832875.931813:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300886784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832875.931852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832875.931890:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832875.931896:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300886912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832875.931915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832875.931952:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:204f2893-acc1-48f1-8f52-36a94d59ea17:3306:1874678300886400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832875.931975:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832875.931987:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886784 00000100:00100000:3.0:1787832875.931992:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886784 00000100:00100000:3.0:1787832875.932233:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300886912 00000100:00100000:3.0:1787832875.932238:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300886912 00000100:00100000:1.0:1787832875.932258:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787832875.932270:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+18:3305:x1874678300886784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832875.932281:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832875.932295:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b6e85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6e7e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.932307:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832875.932431:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+17:3305:x1874678300886784:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.932439:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832875.932442:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300886784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832875.932470:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832875.932479:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+16:3305:x1874678300886912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787832875.932489:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832875.932500:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d5a00/0x72bd9178b14b693e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6937 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832875.932527:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832875.932810:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:204f2893-acc1-48f1-8f52-36a94d59ea17+15:3305:x1874678300886912:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.932818:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787832875.932836:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300886912:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1787832875.933167:0:13032:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9aa4829e7ae0 00000100:00080000:1.0:1787832875.933275:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787832875.933281:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1787832875.933363:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787832875.933437:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787832875.933460:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c3581970000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787832875.933479:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787832875.933482:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787832875.933491:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787832875.933599:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300887040:0@lo:9:umount.0 00000100:00100000:1.0:1787832875.933641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832875.933691:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300887040 00000100:00100000:1.0:1787832875.933696:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300887040 00000100:00100000:1.0:1787832875.933767:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787832875.933775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874678300887040:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787832875.933797:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6acd 00000100:00080000:1.0:1787832875.933806:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c356516f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787832875.933841:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787832875.934182:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1874678300887040:12345-0@lo:9:umount.0 Request processed in 407us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.934201:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787832875.934223:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787832875.934249:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3581970000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787832875.934316:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787832875.934832:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787832875.935957:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787832875.936024:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787832875.936034:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300887040:0@lo:9:umount.0 00000100:00080000:1.0:1787832875.936077:0:13032:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787832875.936112:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c3443124800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787832875.936178:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c356619b370) has no exports 00000100:00100000:2.0:1787832875.936746:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300887168:0@lo:9:umount.0 00000100:00100000:2.0:1787832875.937065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832875.937171:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300887168 00000100:00100000:0.0:1787832875.937180:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300887168 00000100:00080000:3.0:1787832875.937232:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832875.937253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787832875.937263:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874678300887168:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787832875.937288:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bb4 00000100:00080000:0.0:1787832875.937296:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8c3443120000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787832875.937435:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787832875.937735:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832875.938197:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1874678300887168:12345-0@lo:9:umount.0 Request processed in 933us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832875.938207:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787832875.938694:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3443124800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787832875.938773:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787832875.938777:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787832875.939985:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300887168:0@lo:9:umount.0 00000020:00080000:3.0:1787832875.947992:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c356619b370) has no exports 00000020:00000080:3.0:1787832876.023986:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6992 00000020:00000080:3.0:1787832876.024004:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c356513d000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787832876.024019:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787832876.024150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c356513d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787832876.024245:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.024265:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787832876.024270:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c35661999b8) has no exports 00000020:00000080:0.0:1787832876.024731:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b698b 00000020:00000080:0.0:1787832876.024738:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357c686800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787832876.024794:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.024802:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787832876.024805:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357c685800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787832876.024808:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c685800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787832876.024816:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787832876.026475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c686800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787832876.026746:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3566120cc0 - data ffff8c355b62c798/ffff8c357b789400 00000020:01000000:0.0:1787832876.026903:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c35610ec660 - data ffff8c356cf851b0/ffff8c357c67ec00 00000001:00000004:1.0:1787832876.044450:0:13032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787832876.157400:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787832876.157412:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1787832876.157439:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787832876.157442:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787832876.158106:0:6741:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787832876.158112:0:6741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787832876.158124:0:6741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787832876.159478:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787832876.159486:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787832876.159508:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787832876.159510:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787832876.160048:0:7925:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787832876.160054:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787832876.160065:0:7925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787832876.287078:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b695a 00000020:00000080:2.0:1787832876.287091:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566267000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787832876.287476:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566267000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787832876.288658:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b696f 00000020:00000080:2.0:1787832876.288669:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566262000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787832876.288755:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787832876.288761:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832876.288770:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787832876.288775:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c356619cd28) has no exports 00000004:01000000:2.0:1787832876.289225:0:13032:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787832876.289238:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6bad 00000020:00000080:2.0:1787832876.289246:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566170000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787832876.290255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566262000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787832876.290447:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787832876.290486:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566170000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787832876.290507:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.290517:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787832876.290521:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c3442963370) has no exports 00000020:00000080:0.0:1787832876.290529:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6ba6 00000020:00000080:0.0:1787832876.290538:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3443125000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787832876.298249:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787832876.298269:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787832876.298273:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787832876.298282:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787832876.298284:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787832876.300277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3443125000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787832876.307943:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.307962:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787832876.307980:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6ac6 00000020:00000080:0.0:1787832876.307991:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3441913000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787832876.307998:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787832876.308006:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.308012:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787832876.308016:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c3550bb8000) has no exports 00000020:00000080:0.0:1787832876.308025:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6abf 00000020:00000080:0.0:1787832876.308028:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3441915000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787832876.308388:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787832876.308394:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787832876.308399:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787832876.308405:0:13032:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787832876.308407:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787832876.308434:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.308439:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787832876.308466:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.308469:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787832876.308474:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c35818ff000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787832876.308478:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c35818ff000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787832876.308487:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787832876.308678:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6976 00000020:00000080:0.0:1787832876.308684:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566265000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787832876.308688:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787832876.308691:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.308695:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787832876.308697:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c3566198000) has no exports 00000020:00000080:0.0:1787832876.308759:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.308763:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787832876.308766:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b697d 00000020:00000080:0.0:1787832876.308769:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566264800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787832876.310886:0:13032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3543878800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787832876.310898:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3543878800 3 00000020:01000004:0.0:1787832876.310936:0:13032:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c3543878800 from lustre-MDT0000 00000020:00000080:2.0:1787832876.311101:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3443124800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787832876.311112:0:8:0:(genops.c:885:class_export_put()) final put ffff8c3443122800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787832876.311131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3443122800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787832876.311146:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787832876.311219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3441913000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787832876.311226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3441915000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787832876.311231:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3581970000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787832876.311236:0:8:0:(genops.c:885:class_export_put()) final put ffff8c3441913800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787832876.311238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3441913800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787832876.311241:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787832876.311323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566265000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787832876.311327:0:8:0:(genops.c:885:class_export_put()) final put ffff8c3566264000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787832876.311331:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566264000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787832876.311336:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787832876.311401:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.311412:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787832876.311415:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3566265800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787832876.311418:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566265800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787832876.311429:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787832876.311485:0:13032:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787832876.311489:0:13032:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787832876.311493:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787832876.311497:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.311501:0:13032:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787832876.311510:0:13032:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c356ae11000 204f2893-acc1-48f1-8f52-36a94d59ea17 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787832876.311517:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c35738a3370) has exports, disconnecting them 00000020:00080000:0.0:1787832876.311522:0:13032:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c356ae11000), last request at 1787832631 00000020:00000080:2.0:1787832876.311537:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566264800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787832876.311539:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b691b 00000020:00010000:0.0:1787832876.311547:0:13032:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c356ae11000: total 0 00000100:00080000:0.0:1787832876.311553:0:13032:0:(import.c:65:import_set_state_nolock()) ffff8c356ae10800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787832876.311630:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c356ae11000): rc 0 00000020:00080000:0.0:1787832876.311636:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c35738a3370) has no exports 00000020:00010000:2.0:1787832876.312470:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c356ae11000: total 0 00010000:00010000:2.0:1787832876.312504:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c356ae11000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787832876.312532:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215da00/0x72bd9178b14b6c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c4e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215d600/0x72bd9178b14b6a33 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6a2c expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312564:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c354b74d400/0x72bd9178b14b6c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c78 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312575:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215c000/0x72bd9178b14b6c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c24 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312599:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc87a00/0x72bd9178b14b6e69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6e62 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b6e77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6e70 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312654:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c358215c800/0x72bd9178b14b6c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c40 expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312666:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540031200/0x72bd9178b14b6c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72bd9178b14b6c32 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832876.312676:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c356ae11000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787832876.312690:0:5832:0:(genops.c:885:class_export_put()) final put ffff8c356ae11000/204f2893-acc1-48f1-8f52-36a94d59ea17 00010000:00010000:2.0:1787832876.312719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832876.312722:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832876.312724:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787832876.312733:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c356ae11000/204f2893-acc1-48f1-8f52-36a94d59ea17 for MGS 00000020:00000080:2.0:1787832876.312768:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c356ae10800 for MGS 00000100:00100000:1.0:1787832876.313119:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c35464b0400:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1787832876.313203:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c3543061a00:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1787832876.321372:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c3543060400:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1787832876.321742:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321767:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321775:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321793:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321801:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321807:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321814:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321821:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321828:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321835:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321841:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321846:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321853:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321859:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321865:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321871:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321877:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321884:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321891:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321899:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321905:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321911:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321916:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321922:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321929:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321935:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321941:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321947:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321953:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.321958:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322458:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322466:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322473:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322480:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322488:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322493:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322509:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322515:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322522:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322527:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322533:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322538:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322543:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322548:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322553:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322559:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322565:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322571:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322576:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322594:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322600:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322606:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322611:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322617:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322624:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322630:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322636:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322643:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.322697:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.324090:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.324101:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.324107:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.324113:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.324118:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787832876.325216:0:13032:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787832876.325222:0:13032:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787832876.327222:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3546551a80 - data ffff8c355b6acca8/ffff8c3565db0400 00000020:01000000:2.0:1787832876.327364:0:13032:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3542d37d80 - data ffff8c3558f520d8/ffff8c35491e1400 00000020:00000080:2.0:1787832876.328184:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b68ff 00000020:00000080:2.0:1787832876.328192:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c354644a000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787832876.328211:0:13032:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3543878800 from MGS, refs=2 00000020:01000004:2.0:1787832876.328214:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3543878800 2 00000020:01000004:2.0:1787832876.328217:0:13032:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c3543878800 from MGS 00000020:00000080:2.0:1787832876.328239:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787832876.328245:0:13032:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787832876.328247:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3544f93800/MGS 00000020:00000080:2.0:1787832876.328250:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3544f93800/MGS for MGS 00000020:01000000:2.0:1787832876.328256:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787832876.328322:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787832876.328327:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832876.328333:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787832876.328340:0:13032:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c357c6d5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787832876.328346:0:13032:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8c356547cd28) has exports, disconnecting them 00000020:00080000:2.0:1787832876.328350:0:13032:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c357c6d5800), last request at 1787832632 00000020:00000080:2.0:1787832876.328355:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b69ca 00000020:00080000:2.0:1787832876.328366:0:13032:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c357c6d5800): rc 0 00000020:00000080:2.0:1787832876.328370:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357c6d5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787832876.331561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c354644a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787832876.331590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c6d5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787832876.338786:0:13032:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787832876.338797:0:13032:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787832876.338802:0:13032:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787832876.338811:0:13032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787832876.338866:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357c6d6000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787832876.339039:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.339060:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787832876.339065:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c357c6d4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787832876.339070:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c6d4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787832876.339081:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787832876.339148:0:13032:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3543878800 1 00000020:00000080:0.0:1787832876.339155:0:13032:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b68f1 00000020:00000080:0.0:1787832876.339162:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c3544f91800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787832876.339178:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787832876.339182:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832876.339187:0:13032:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787832876.339191:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c35738a4d28) has no exports 00000020:00000080:1.0:1787832876.339241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3544f91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787832876.373203:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787832876.373216:0:13032:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787832876.373233:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c354387e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787832876.373237:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c354387e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787832876.373247:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787832876.373391:0:13032:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c354387b800 00000020:01000000:1.0:1787832876.373415:0:13032:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787832876.373419:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787832876.373424:0:13032:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787832876.373427:0:13032:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c35738a0000) has no exports 00000100:00100000:1.0:1787832876.373496:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c35491fac00:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1787832876.377866:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c354379b800:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1787832876.383173:0:10395:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c3565db6400:10395] 3 exiting: rc = 0 00000100:00100000:1.0:1787832876.383308:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c35491fa400:5845] 2 exiting: rc = 0 00000100:00100000:1.0:1787832876.383376:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383384:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383390:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383396:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383402:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383409:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383415:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383421:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383428:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383434:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383440:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383446:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383453:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383459:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383464:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383468:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383474:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383479:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383485:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383492:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383497:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383504:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383509:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383531:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383538:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383546:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383559:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383565:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383571:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383576:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383593:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383599:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383605:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383610:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383640:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383648:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383653:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383659:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383664:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383669:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383674:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383679:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383684:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383688:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383694:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383715:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383722:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383728:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383735:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383742:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383749:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383755:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383760:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383767:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383773:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383792:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383799:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383804:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383817:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383823:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383830:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383836:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383841:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.383849:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.403541:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c356ae8a800:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1787832876.403800:0:12588:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8c3442345600:12588] 2 exiting: rc = 0 00000100:00100000:3.0:1787832876.407692:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c356ae8b400:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1787832876.407847:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407858:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407867:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407879:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407888:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407897:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407905:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407913:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407919:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407927:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407935:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407942:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.407953:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408093:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408102:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408107:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408112:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408117:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408122:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408127:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408132:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408137:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408142:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408148:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408153:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408159:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408165:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408171:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408176:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408195:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408201:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408207:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408213:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408218:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408224:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408229:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408235:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408240:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408246:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408252:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408257:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408262:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408267:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408272:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408276:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408282:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408287:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408293:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408299:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408304:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408315:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408321:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408328:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408333:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408339:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408353:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408493:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408498:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408503:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408508:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408513:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408517:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408523:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.408528:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787832876.409666:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c356ae8a400:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787832876.411812:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c356ae8bc00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1787832876.412008:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412018:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412025:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412032:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412039:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412047:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412056:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412063:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412070:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412077:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412095:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412104:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412110:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412116:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412124:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412130:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412136:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412143:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412151:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412157:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412171:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412180:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412204:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412211:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412218:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412224:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412230:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412242:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412248:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412255:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412262:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412267:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412273:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412279:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412300:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412321:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412327:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412333:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412339:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412346:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412352:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412358:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412365:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412544:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412556:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412563:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412600:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412609:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412615:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412624:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412630:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412638:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412643:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412651:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412669:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412674:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412681:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412688:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412737:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412745:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412752:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412761:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.412768:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832876.413102:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.428818:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c356ae8a600:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1787832876.445295:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c356ae8b600:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1787832876.445406:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445415:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445421:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445426:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445432:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445437:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445442:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445447:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445463:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445470:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445475:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445481:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445487:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445492:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445497:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445502:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445507:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445512:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445530:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445536:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445541:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445545:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445550:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445554:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445559:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445564:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445570:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445575:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445591:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445596:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445601:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445607:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445612:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445618:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445624:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445630:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445636:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445641:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445647:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445652:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445657:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445661:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445667:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445671:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445677:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445683:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445689:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445694:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445717:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445724:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445729:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445736:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445741:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445753:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445758:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445763:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445768:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445774:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445780:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445786:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445792:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445797:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445803:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.445809:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446183:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c356ae8ac00:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1787832876.446409:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c35491e6a00:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1787832876.446526:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446533:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446538:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446546:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446552:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446558:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446564:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446570:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446588:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446594:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446601:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446607:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446613:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446619:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446625:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446631:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446636:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446642:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446648:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446654:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446659:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446665:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446671:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446685:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446691:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446696:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446728:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446735:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446741:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446747:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446753:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446758:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446764:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446770:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446776:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446782:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446787:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446793:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446800:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446807:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446812:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446818:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446825:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446830:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446836:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446842:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446848:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446854:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446860:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446866:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446872:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446878:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446884:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446889:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446895:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446900:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446906:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446912:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446925:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446931:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446938:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446944:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446949:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.446955:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.447275:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c3581955400:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1787832876.449057:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c3581955a00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1787832876.449145:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449155:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449165:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449171:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449177:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449188:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449193:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449199:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449206:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449212:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449218:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449223:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449229:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449234:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449239:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449245:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449250:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449256:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449261:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449267:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449273:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449279:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449284:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449290:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449295:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449301:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449306:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449311:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449328:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449333:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449339:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449344:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449350:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449356:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449362:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449367:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449372:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449377:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449382:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449388:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449392:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449397:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449402:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449407:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449412:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449417:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449422:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449428:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449433:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449438:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449444:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449647:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449657:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449662:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449669:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449674:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449680:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449685:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449691:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449696:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449776:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449783:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449788:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.449800:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.450340:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c3558b2ec00:5859] 2 exiting: rc = 0 00000100:00100000:1.0:1787832876.450623:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c3558b2f800:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1787832876.453187:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c3581954a00:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1787832876.453426:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453435:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453441:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453448:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453466:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453474:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453505:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453513:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453519:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453525:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453532:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453538:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453545:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453551:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453558:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453565:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453571:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453588:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453595:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453601:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453607:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453613:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453619:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453624:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453630:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453636:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453641:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453647:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453652:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453658:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453679:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453686:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453698:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453745:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453751:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453758:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453764:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453770:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453778:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453783:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453789:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453795:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453801:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453807:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453813:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453818:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453824:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453830:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453835:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453841:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453846:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453853:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453859:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453864:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453883:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453890:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453896:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453901:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453907:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453913:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453919:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453925:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453931:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832876.453937:0:13032:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787832876.462278:0:13032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832876.462291:0:13032:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787832876.462296:0:13032:0:(genops.c:885:class_export_put()) final put ffff8c35437ac000/MDS_uuid 00000020:00000080:0.0:1787832876.462300:0:13032:0:(genops.c:844:class_export_destroy()) destroying export ffff8c35437ac000/MDS_uuid for MDS 00000020:01000000:0.0:1787832876.462321:0:13032:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787832876.462449:0:13032:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787832876.748885:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832877.325657:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300887424:0@lo:400:kworker.0 00000400:00000100:0.0:1787832877.325737:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300887424 offset 0 length 224: 4 00000100:00100000:0.0:1787832877.325788:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787832877.325794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300887296:0@lo:400:kworker.0 00000400:00000100:0.0:1787832877.325812:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874678300887296 offset 0 length 224: 4 00000100:00100000:3.0:1787832877.326644:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300887552:0@lo:400:kworker.0 00000400:00000100:3.0:1787832877.326676:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300887552 offset 0 length 224: 4 00010000:00010000:2.0:1787832877.772063:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787832878.401369:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787832878.401380:0:7648:0:(genops.c:885:class_export_put()) final put ffff8c3443122000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787832878.401399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3443122000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787832878.401443:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3443120000 for lustre-OST0001 00010000:00010000:2.0:1787832878.800053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787832879.806459:0:13182:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:2.0:1787832879.823923:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787832879.836835:0:13182:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787832879.836885:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832879.836919:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832879.836927:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832879.836935:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832879.836961:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787832879.836966:0:13182:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787832879.836990:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787832879.837002:0:13182:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465dc3c0 x1874678300887424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832879.837023:0:13182:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787832879.837029:0:13182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787832879.837054:0:13182:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ea000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787832879.837063:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300887424:0@lo:400:kworker.0 00000100:00100000:0.0:1787832879.837119:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300887680:0@lo:39:umount.0 00000400:00000100:0.0:1787832879.837169:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300887680 offset 0 length 224: 4 00010000:00010000:2.0:1787832879.837187:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832879.837194:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832879.837202:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c354b74cc00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832879.837205:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832879.837214:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832879.837221:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832879.837227:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787832879.837237:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787832879.837239:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787832879.837268:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832879.837275:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787832879.837310:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832879.837318:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c354b74cc00/0x72bd9178b14b6c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72bd9178b14b6c47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832879.837321:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787832879.837332:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832879.837334:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832879.837334:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300887808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832879.837336:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832879.837373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832879.837510:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300887808 00000100:00100000:1.0:1787832879.837533:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300887808 00000100:00100000:1.0:1787832879.837585:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787832879.837592:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1874678300887808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787832879.837600:0:8455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787832879 with bad export cookie 8267924438478711067 00000100:00100000:1.0:1787832879.850278:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1874678300887808:12345-0@lo:103:ldlm_bl.0 Request processed in 12672us (12893us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787832879.850294:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787832879.850387:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787832879.850405:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8c3542f11800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787832879.850410:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787832879.870545:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.134@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787832879.870551:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787832879.870562:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465dfc00 x1874678300887296/t0(0) o400->MGC192.168.201.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787832893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832879.870668:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c34430ef0c0 x1874678300887808/t0(0) o103->MGC192.168.201.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787832895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787832879.872008:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787832879.872011:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787832879.872013:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787832879.872018:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8c3542f11800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787832879.872026:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:3.0:1787832879.872035:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff8c3542f11800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832879.872146:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c34430ee940 x1874678300887936/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787832879.872181:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:204f2893-acc1-48f1-8f52-36a94d59ea17:3305:1874678300887808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787832879.872247:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300887936:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787832879.872295:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874678300887936 offset 0 length 520: 4 00000100:00100000:1.0:1787832879.881282:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:204f2893-acc1-48f1-8f52-36a94d59ea17:3308:1874678300887296:0@lo:400:kworker.0 00010000:00010000:2.0:1787832880.844113:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787832880.982447:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787832880.982455:0:6720:0:(genops.c:885:class_export_put()) final put ffff8c356516d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787832880.982534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c356516d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787832880.983008:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c356516f000 for lustre-OST0000 00010000:00010000:2.0:1787832881.872135:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787832882.443849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787832882.443861:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787832882.444214:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832882.444235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300888064:0@lo:400:kworker.0 00000400:00000100:1.0:1787832882.444302:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300888064 offset 0 length 224: 4 00010000:00010000:2.0:1787832882.895437:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832883.916005:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787832884.494596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787832884.494608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787832884.494745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832884.494769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300888192:0@lo:400:kworker.0 00000400:00000100:1.0:1787832884.494829:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300888192 offset 0 length 224: 4 00010000:00010000:2.0:1787832884.940080:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832885.964646:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832886.989810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832888.012268:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832889.038655:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832889.099878:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832879/real 1787832879] req@ffff8c34430ee940 x1874678300887936/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787832889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832889.099919:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c34430ee940 x1874678300887936/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787832889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832889.099952:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832879/real 1787832879] req@ffff8c3565b6f840 x1874678300887680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787832889 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832889.099966:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3565b6f840 x1874678300887680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787832889 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787832889.099986:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3542f11800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787832889.100018:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787832889.100022:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300887936:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787832889.100029:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787832889.100046:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300887680:0@lo:39:umount.0 00000100:00080000:3.0:1787832889.100109:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787832889.100115:0:13182:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787832889.100122:0:13182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787832889.103083:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787832889.103096:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787832889.103125:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c3542f11800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787832889.103135:0:37:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 402 00000100:00080000:0.0:1787832889.103143:0:37:0:(import.c:589:import_select_connection()) MGC192.168.201.134@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787832889.103152:0:37:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff8c3542f11800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787832889.103199:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c35465dde00 x1874678300888320/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787832889.103289:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787832889.103323:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300888448:0@lo:400:kworker.0 00000400:00000100:0.0:1787832889.103417:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300888448 offset 0 length 224: 4 00000100:00100000:1.0:1787832889.105090:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300888320:0@lo:250:kworker.0 00000400:00000100:1.0:1787832889.105154:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874678300888320 offset 0 length 520: 4 00010000:00010000:3.0:1787832889.108061:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108088:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108097:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108106:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108138:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787832889.108147:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108153:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108176:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108183:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832889.108214:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787832889.108219:0:13182:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787832889.108253:0:13182:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787832889.108258:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787832889.108263:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787832889.108270:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787832889.108276:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c3565478000) has no exports 00010000:00010000:2.0:1787832889.108501:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787832889.108512:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108523:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832889.108527:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108537:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832889.108546:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832889.108552:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787832889.108554:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787832889.108557:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787832889.108585:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:2.0:1787832889.108590:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108597:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b6c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c55 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108626:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832889.108630:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108636:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1787832889.108639:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108646:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832889.108652:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832889.108658:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787832889.108660:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787832889.108662:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787832889.108667:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:2.0:1787832889.108670:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832889.108677:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c3540031a00/0x72bd9178b14b6e70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787832889.108689:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c3565478000) has no exports 00010000:00010000:2.0:1787832889.108743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832889.108746:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832889.108747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832889.109131:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787832889.120124:0:13182:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c35465512a0 - data ffff8c356cf5e870/ffff8c3565db3800 00000020:01000000:3.0:1787832889.120350:0:13182:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c354631a360 - data ffff8c355b64e6c0/ffff8c357b6a1400 00100000:10000000:3.0:1787832889.133491:0:13182:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787832889.187988:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6a4f 00000020:00000080:2.0:1787832889.188004:0:13182:0:(genops.c:885:class_export_put()) final put ffff8c34418d9800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787832889.188037:0:13182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c357c687800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787832889.188042:0:13182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357c687800 2 00000020:01000004:2.0:1787832889.188046:0:13182:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c357c687800 from lustre-OST0000 00000020:00000080:2.0:1787832889.188079:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787832889.188091:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787832889.188095:0:13182:0:(genops.c:885:class_export_put()) final put ffff8c34418dc800/lustre-OST0000_UUID 00000020:00000080:2.0:1787832889.188098:0:13182:0:(genops.c:844:class_export_destroy()) destroying export ffff8c34418dc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787832889.188115:0:13182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787832889.188187:0:13182:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787832889.188191:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787832889.188195:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832889.188199:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787832889.188206:0:13182:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c3441911800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787832889.188211:0:13182:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8c3543793370) has exports, disconnecting them 00000020:00080000:2.0:1787832889.188216:0:13182:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c3441911800), last request at 1787832650 00000020:00000080:2.0:1787832889.188220:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6a79 00000020:00080000:2.0:1787832889.188228:0:13182:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c3441911800): rc 0 00000020:00000080:2.0:1787832889.188233:0:13182:0:(genops.c:885:class_export_put()) final put ffff8c3441911800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787832889.188931:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c34418d9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787832889.188950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3441911800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787832889.189162:0:13182:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787832889.189169:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787832889.189174:0:13182:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787832889.189181:0:13182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787832889.189409:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787832889.189415:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787832889.189419:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c357b9ea000 for lustre-MDT0000-lwp-OST0000 00000020:01000004:3.0:1787832889.189422:0:13182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357c687800 1 00000020:00000080:3.0:1787832889.189427:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6a09 00000020:00000080:1.0:1787832889.189432:0:37:0:(genops.c:885:class_export_put()) final put ffff8c357b9ec000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787832889.189433:0:13182:0:(genops.c:885:class_export_put()) final put ffff8c3549716800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787832889.189435:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357b9ec000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787832889.189439:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787832889.189446:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787832889.189449:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787832889.189453:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787832889.189469:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c35738a19b8) has no exports 00000020:00000080:1.0:1787832889.189498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3549716800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787832889.258607:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787832889.258628:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787832889.258636:0:13182:0:(genops.c:885:class_export_put()) final put ffff8c357c687000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787832889.258641:0:13182:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c687000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787832889.258656:0:13182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787832889.258849:0:13182:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c357c684000 00000020:02000400:3.0:1787832889.258902:0:13182:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787832890.061724:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832891.084014:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832892.107865:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787832892.245234:0:13335:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787832892.270855:0:13335:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787832892.270943:0:13335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832892.270959:0:13335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832892.270966:0:13335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832892.270975:0:13335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832892.270998:0:13335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787832892.271004:0:13335:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787832892.271027:0:13335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787832892.271038:0:13335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465df480 x1874678300887552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832892.271063:0:13335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465dc000 x1874678300888064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832892.271079:0:13335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c3565b6c780 x1874678300888192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832900 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832892.271092:0:13335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465ded00 x1874678300888448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832905 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832892.271101:0:13335:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787832892.271108:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300888064:0@lo:400:kworker.0 00000100:00100000:1.0:1787832892.271119:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300888192:0@lo:400:kworker.0 00000100:00080000:1.0:1787832892.271134:0:13335:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787832892.271157:0:13335:0:(import.c:65:import_set_state_nolock()) ffff8c3566169000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787832892.271210:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300888576:0@lo:39:umount.0 00000400:00000100:1.0:1787832892.271257:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874678300888576 offset 0 length 224: 4 00000100:00100000:0.0:1787832892.271358:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300887552:0@lo:400:kworker.0 00010000:00010000:3.0:1787832892.271487:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832892.271495:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832892.271504:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832892.271507:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832892.271516:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832892.271523:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832892.271528:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787832892.271531:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787832892.271534:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787832892.271546:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:3.0:1787832892.271550:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832892.271557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad41200/0x72bd9178b14b6c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c2b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832892.271574:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832892.271576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832892.271578:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832892.271594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874678300888448:0@lo:400:kworker.0 00010000:00010000:2.0:1787832893.133243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832894.157403:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787832894.220898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787832894.220907:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787832895.181631:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832896.204083:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832897.229312:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832898.256281:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832899.276526:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787832899.341267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787832899.341280:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787832900.301126:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832901.327816:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832902.348017:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832902.476157:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832892/real 1787832892] req@ffff8c357b6930c0 x1874678300888576/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787832902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832902.476193:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c357b6930c0 x1874678300888576/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787832902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787832902.476209:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3566169000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787832902.476231:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300888576:0@lo:39:umount.0 00000100:00080000:2.0:1787832902.476301:0:13335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787832902.476306:0:13335:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787832902.476311:0:13335:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787832902.477429:0:13335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477445:0:13335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477453:0:13335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477460:0:13335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477490:0:13335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832902.477497:0:13335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477503:0:13335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477509:0:13335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477531:0:13335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.477561:0:13335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787832902.477566:0:13335:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787832902.477586:0:13335:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787832902.477590:0:13335:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787832902.477595:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832902.477601:0:13335:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787832902.477606:0:13335:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c3550bbcd28) has no exports 00000020:00080000:2.0:1787832902.477632:0:13335:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c3550bbcd28) has no exports 00010000:00010000:3.0:1787832902.478093:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832902.478100:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832902.478108:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c358215d000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832902.478112:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832902.478115:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832902.478129:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832902.478136:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832902.478137:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832902.478143:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc1c2dc20) 10000000:01000000:3.0:1787832902.478144:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1787832902.478146:0:7636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832902.478147:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787832902.478149:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787832902.478153:0:7636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832902.478159:0:7636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832902.478162:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 10000000:01000000:0.0:1787832902.478163:0:7636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787832902.478165:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832902.478165:0:7636:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787832902.478167:0:7636:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787832902.478172:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215d000/0x72bd9178b14b6c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832902.478179:0:7636:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:0.0:1787832902.478182:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832902.478187:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad40000/0x72bd9178b14b6e62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6e69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832902.478192:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832902.478194:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832902.478196:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832902.478199:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832902.478200:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832902.478201:0:7636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787832902.481449:0:13335:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3546551a20 - data ffff8c355b616000/ffff8c3566014800 00000020:01000000:2.0:1787832902.483438:0:13335:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3566081c00 - data ffff8c355b4366c0/ffff8c355ed90c00 00100000:10000000:2.0:1787832902.495091:0:13335:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787832902.531483:0:13335:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6b1a 00000020:00000080:2.0:1787832902.531493:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c357bb21000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787832902.531516:0:13335:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c357b0a1800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787832902.531520:0:13335:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357b0a1800 2 00000020:01000004:2.0:1787832902.531524:0:13335:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c357b0a1800 from lustre-OST0001 00000020:00000080:2.0:1787832902.531548:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787832902.531558:0:13335:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787832902.531561:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c356616c800/lustre-OST0001_UUID 00000020:00000080:2.0:1787832902.531564:0:13335:0:(genops.c:844:class_export_destroy()) destroying export ffff8c356616c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787832902.531574:0:13335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787832902.531670:0:13335:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 204f2893-acc1-48f1-8f52-36a94d59ea17->MGS 00010000:00010000:2.0:1787832902.531687:0:13335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832902.531699:0:13335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832902.531747:0:13335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787832902.531750:0:13335:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787832902.531753:0:13335:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787832902.531767:0:13335:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:2.0:1787832902.531771:0:13335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c35429d5000/0x72bd9178b14b6a2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6a33 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832902.531786:0:13335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787832902.531793:0:13335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832902.531799:0:13335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787832902.531801:0:13335:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787832902.531803:0:13335:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787832902.531815:0:13335:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3542f11800 00010000:00010000:2.0:1787832902.531819:0:13335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c358215ca00/0x72bd9178b14b6c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72bd9178b14b6c7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787832902.531836:0:13335:0:(import.c:65:import_set_state_nolock()) ffff8c3542f11800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787832902.531840:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787832902.531842:0:13335:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787832902.531844:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787832902.531847:0:13335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787832902.531858:0:13335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c35465dde00 x1874678300888320/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787832904 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787832902.531872:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787832902.531874:0:13335:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1787832902.531955:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:204f2893-acc1-48f1-8f52-36a94d59ea17:3304:1874678300888320:0@lo:250:kworker.0 10000000:01000000:2.0:1787832902.532131:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787832902.532143:0:13335:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b690d 00000020:00000080:2.0:1787832902.532148:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c35437ab000/204f2893-acc1-48f1-8f52-36a94d59ea17 00000020:01000000:2.0:1787832902.532154:0:13335:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.134@tcp (flags='') 00000020:00000080:2.0:1787832902.532158:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832902.532162:0:13335:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787832902.532165:0:13335:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c3543794d28) has no exports 10000000:01000000:0.0:1787832902.532219:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787832902.532284:0:13335:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.134@tcp: client import never connected 00000100:00080000:2.0:1787832902.532287:0:13335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787832902.532289:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787832902.532291:0:13335:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787832902.532293:0:13335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787832902.532330:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787832902.532334:0:13335:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.134@tcp (uuid 204f2893-acc1-48f1-8f52-36a94d59ea17) 00000020:01000000:2.0:1787832902.532338:0:13335:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787832902.532342:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787832902.532345:0:13335:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787832902.532349:0:13335:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c357c681000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787832902.532353:0:13335:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8c35654799b8) has exports, disconnecting them 00000020:00080000:2.0:1787832902.532356:0:13335:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c357c681000), last request at 1787832670 00000020:00000080:2.0:1787832902.532360:0:13335:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6b44 00000020:00080000:2.0:1787832902.532369:0:13335:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c357c681000): rc 0 00000020:00000080:2.0:1787832902.532372:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c357c681000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787832902.533083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357bb21000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787832902.533098:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c35437ab000/204f2893-acc1-48f1-8f52-36a94d59ea17 for MGC192.168.201.134@tcp 00000020:00000080:1.0:1787832902.533103:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3542f11800 for MGC192.168.201.134@tcp 00000020:00000080:1.0:1787832902.533110:0:8:0:(genops.c:885:class_export_put()) final put ffff8c3542f11000/204f2893-acc1-48f1-8f52-36a94d59ea17 00000020:00000080:1.0:1787832902.533112:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3542f11000/204f2893-acc1-48f1-8f52-36a94d59ea17 for MGC192.168.201.134@tcp 00000020:01000000:1.0:1787832902.533115:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.134@tcp (204f2893-acc1-48f1-8f52-36a94d59ea17) 00000020:00000080:1.0:1787832902.533366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c357c681000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787832902.541823:0:13335:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787832902.541832:0:13335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787832902.541836:0:13335:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787832902.541843:0:13335:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787832902.541911:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787832902.542067:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3566169000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787832902.552808:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787832902.553063:0:7636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787832902.553216:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c3543148800:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1787832902.553312:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c354309c200:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1787832902.553615:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787832902.553920:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c354309ce00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1787832902.554036:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c355cf50400:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1787832902.554092:0:8455:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c3565db6800:8455] 3 exiting: rc = 0 00000100:00100000:1.0:1787832902.554162:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c35484fb000:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1787832902.554295:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554302:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554308:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554314:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554331:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554337:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554343:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554348:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554354:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554359:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554365:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554370:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554376:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554390:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554411:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554417:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554423:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554429:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554434:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554439:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554444:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554449:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554454:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554459:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554465:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554471:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554476:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554481:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554486:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554492:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554497:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554503:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554508:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554513:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554522:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554528:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554532:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554538:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554543:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554548:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554554:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554559:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554564:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554569:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554575:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554580:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554585:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554590:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554595:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554609:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554614:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554619:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554625:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554630:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554636:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554642:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554647:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554652:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554657:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554663:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554668:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554672:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554677:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.554682:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787832902.555666:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832902.555675:0:13335:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787832902.555680:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c3566168800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787832902.555685:0:13335:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3566168800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787832902.555691:0:13335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787832902.555767:0:13335:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357b0a1800 1 00000020:00000080:0.0:1787832902.555774:0:13335:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72bd9178b14b6ae9 00000020:00000080:0.0:1787832902.555780:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c3441910000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787832902.555793:0:13335:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787832902.555797:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832902.555802:0:13335:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787832902.555805:0:13335:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c3550bb99b8) has no exports 00000020:00000080:1.0:1787832902.555941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3441910000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787832902.568308:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832902.568333:0:13335:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787832902.568339:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c356616d800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787832902.568343:0:13335:0:(genops.c:844:class_export_destroy()) destroying export ffff8c356616d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787832902.568354:0:13335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787832902.568558:0:13335:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c356616e000 00000020:01000000:0.0:1787832902.568590:0:13335:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787832902.568594:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787832902.568598:0:13335:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787832902.568602:0:13335:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c356547b370) has no exports 00000020:00000080:0.0:1787832902.568627:0:13335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787832902.568633:0:13335:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787832902.568636:0:13335:0:(genops.c:885:class_export_put()) final put ffff8c3549711000/OSS_uuid 00000020:00000080:0.0:1787832902.568638:0:13335:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3549711000/OSS_uuid for OSS 00000020:01000000:0.0:1787832902.568643:0:13335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787832902.568744:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c3565166800:6696] 1 exiting: rc = 0 00000100:00080000:2.0:1787832902.568857:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787832902.571314:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c3441fb4800:8408] 3 exiting: rc = 0 00000100:00100000:1.0:1787832902.571432:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c357b5db000:6697] 2 exiting: rc = 0 00000100:00100000:1.0:1787832902.571487:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c3565166e00:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1787832902.571813:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571824:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571831:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571837:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571843:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571848:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571854:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571859:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571865:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571870:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571876:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571882:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571888:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571894:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571899:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571905:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571911:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571917:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571923:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571929:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571935:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571941:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571948:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571953:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571959:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571974:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571980:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.571985:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572110:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572119:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572134:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572139:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572161:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572169:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572176:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572182:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572187:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572192:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572197:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572202:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572208:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572213:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572218:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572223:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572228:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572234:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572240:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572245:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572251:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572256:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572267:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572272:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572277:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572282:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572286:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572291:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572296:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572301:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572306:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572311:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572336:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572341:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572346:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.572356:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787832902.573742:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c3565166200:6699] 1 exiting: rc = 0 00000100:00100000:1.0:1787832902.574055:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c3565167c00:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1787832902.574156:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574166:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574173:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574178:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574183:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574188:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574194:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574199:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574204:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574210:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574215:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574220:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574225:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574231:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574236:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574241:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574246:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574251:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574257:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574262:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574268:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574273:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574279:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574284:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574289:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574294:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574299:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574304:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574310:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574315:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574330:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574350:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574355:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574361:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574366:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574371:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574376:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574382:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574387:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574392:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574397:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574402:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574407:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574413:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574418:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574423:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574428:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574434:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574439:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574445:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574451:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574457:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574462:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574467:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574472:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574476:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574481:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574486:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574492:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574497:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574502:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574508:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574512:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.574524:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.575441:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c3565166a00:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1787832902.575791:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c357b9e1000:6702] 2 exiting: rc = 0 00000100:00100000:1.0:1787832902.576010:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c3565167600:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1787832902.576193:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576211:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576217:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576223:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576229:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576234:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576241:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576246:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576252:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576258:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576264:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576269:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576275:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576280:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576298:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576304:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576309:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576315:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576330:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576337:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576343:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576349:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576354:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576359:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576365:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576371:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576376:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576382:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576387:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576393:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576398:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576403:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576409:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576415:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576420:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576426:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576439:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576444:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576462:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576468:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576473:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576478:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576483:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576488:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576494:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576499:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576505:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576510:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576515:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576521:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576526:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576533:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576539:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576545:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576551:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576556:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576569:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576576:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576583:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576588:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576593:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576598:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576603:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.576609:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832902.585746:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c357b9e0800:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1787832902.585832:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c357b9e1200:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1787832902.585943:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585951:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585957:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585964:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585970:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585975:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.585981:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586060:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586066:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586072:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586078:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586084:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586090:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586096:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586102:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586108:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586160:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586166:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586174:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586180:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586186:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586192:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586197:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586203:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586208:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586214:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586219:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586225:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586231:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586236:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586243:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586249:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586255:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586261:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586267:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586273:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586278:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586284:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586289:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586295:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586301:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586306:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586387:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586395:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586401:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586406:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586412:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586418:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586423:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586429:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586435:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586441:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586447:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586453:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586459:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586465:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586471:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586476:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586481:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586485:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586490:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586495:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586500:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.586505:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787832902.588006:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c3560281000:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1787832902.588166:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c3560281a00:6706] 1 exiting: rc = 0 00000100:00100000:0.0:1787832902.588302:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588311:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588317:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588475:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588483:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588497:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588505:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588512:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588518:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588524:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588531:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588537:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588545:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588562:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588568:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588575:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588581:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588605:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588613:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588618:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588625:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588631:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588637:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588648:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588656:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588663:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588671:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588677:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588684:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588861:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588872:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588879:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588887:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588894:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588901:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588907:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588914:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588924:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588931:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588939:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588947:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588968:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588977:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.588984:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589046:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589056:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589063:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589070:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589084:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589090:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589096:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589102:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589108:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589140:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589149:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589156:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589162:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589168:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589175:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589182:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589190:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589197:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589204:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787832902.589218:0:13335:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787832902.597604:0:13335:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787832916.517086:0:13952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787832924.794084:0:14416:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787832924.794097:0:14416:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787832924.794219:0:14416:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c357b0a7000 00000020:01000004:1.0:1787832924.794238:0:14416:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787832924.794247:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787832924.794261:0:14416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c3550bbb370) 00000020:00000080:1.0:1787832924.794274:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787832924.831120:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787832924.833115:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787832924.833423:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 521: rc = 0 00100000:10000000:3.0:1787832924.833506:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:3.0:1787832924.833689:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787832924.833944:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 521: rc = 0 00100000:10000000:3.0:1787832924.834039:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 521: rc = 0 00100000:10000000:3.0:1787832924.834138:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 521: rc = 0 00100000:10000000:3.0:1787832924.834233:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 521: rc = 0 00100000:10000000:3.0:1787832924.834468:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 523: rc = 0 00100000:10000000:3.0:1787832924.838338:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 544: rc = 0 00100000:10000000:3.0:1787832924.838430:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 544: rc = 0 00100000:10000000:3.0:1787832924.839565:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.844565:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 232: rc = 0 00100000:10000000:2.0:1787832924.845102:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.845994:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 232: rc = 0 00100000:10000000:2.0:1787832924.846275:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.847981:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 232: rc = 0 00100000:10000000:2.0:1787832924.848253:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 232: rc = 0 00100000:10000000:2.0:1787832924.851112:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.853043:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 232: rc = 0 00100000:10000000:2.0:1787832924.853485:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.855090:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 232: rc = 0 00100000:10000000:2.0:1787832924.855344:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 232: rc = 0 00100000:10000000:2.0:1787832924.857894:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 560: rc = 0 00100000:10000000:2.0:1787832924.859459:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 560: rc = 0 00100000:10000000:2.0:1787832924.860815:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 560: rc = 0 00100000:10000000:2.0:1787832924.861106:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 560: rc = 0 00100000:10000000:2.0:1787832924.862997:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 560: rc = 0 00100000:10000000:2.0:1787832924.864740:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 560: rc = 0 00100000:10000000:2.0:1787832924.865025:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 560: rc = 0 00100000:10000000:2.0:1787832924.866492:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 560: rc = 0 00100000:10000000:2.0:1787832924.867102:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 560: rc = 0 00100000:10000000:2.0:1787832924.868950:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 560: rc = 0 00100000:10000000:2.0:1787832924.869231:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 560: rc = 0 00100000:10000000:2.0:1787832924.870494:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 560: rc = 0 00100000:10000000:2.0:1787832924.870841:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 560: rc = 0 00100000:10000000:2.0:1787832924.871094:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 560: rc = 0 00100000:10000000:2.0:1787832924.871364:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 560: rc = 0 00100000:10000000:2.0:1787832924.871622:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 560: rc = 0 00100000:10000000:2.0:1787832924.871914:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 560: rc = 0 00100000:10000000:2.0:1787832924.872151:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 560: rc = 0 00100000:10000000:2.0:1787832924.872384:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 560: rc = 0 00100000:10000000:2.0:1787832924.872625:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 560: rc = 0 00100000:10000000:2.0:1787832924.872922:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 560: rc = 0 00100000:10000000:2.0:1787832924.873169:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 560: rc = 0 00100000:10000000:2.0:1787832924.873403:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 560: rc = 0 00100000:10000000:2.0:1787832924.873691:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 560: rc = 0 00100000:10000000:3.0:1787832924.875991:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 560: rc = 0 00100000:10000000:3.0:1787832924.876495:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 560: rc = 0 00100000:10000000:3.0:1787832924.876948:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 560: rc = 0 00100000:10000000:3.0:1787832924.877686:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 560: rc = 0 00100000:10000000:3.0:1787832924.878028:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 560: rc = 0 00100000:10000000:3.0:1787832924.879015:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 560: rc = 0 00100000:10000000:3.0:1787832924.879293:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 560: rc = 0 00100000:10000000:3.0:1787832924.880440:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 560: rc = 0 00100000:10000000:3.0:1787832924.880997:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 237: rc = 0 00100000:10000000:3.0:1787832924.881954:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787832924.882125:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 545: rc = 0 00100000:10000000:3.0:1787832924.882836:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787832924.882901:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 545: rc = 0 00100000:10000000:3.0:1787832924.883083:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787832924.883149:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 545: rc = 0 00100000:10000000:3.0:1787832924.883829:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787832924.883898:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 227: rc = 0 00100000:10000000:3.0:1787832924.884095:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787832924.884159:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 227: rc = 0 00100000:10000000:3.0:1787832924.884420:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787832924.884484:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 227: rc = 0 00000020:00000080:3.0:1787832924.884971:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787832924.884980:0:14416:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787832924.884991:0:14416:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7c0e 00000020:01000004:3.0:1787832924.884999:0:14416:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787832924.885003:0:14416:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787832924.885009:0:14416:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c357b0a7000 from MGS 00000020:01000004:3.0:1787832924.885012:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787832924.885023:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c356547b370) 00000020:00000080:3.0:1787832924.885034:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787832924.885086:0:14416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357b0a7000 from MGS, refs=2 00080000:01000000:3.0:1787832924.885091:0:14416:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787832924.885096:0:14416:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7c1c 00000100:00100000:3.0:1787832924.885193:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787832924.885406:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787832924.885413:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787832924.887456:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787832924.887466:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787832924.890341:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787832924.890527:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787832924.890533:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787832924.894339:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787832924.894351:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787832924.895749:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787832924.895757:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787832924.896670:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832924.896674:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832924.896675:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832924.897513:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832924.897516:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832924.897518:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832924.899678:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787832924.905200:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787832924.919417:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787832924.919436:0:14416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787832924.919440:0:14416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787832924.921827:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787832924.922146:0:14416:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787832924.922289:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787832924.929767:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787832924.930157:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832924.930339:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787832924.930345:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787832924.932766:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787832924.932781:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787832924.933297:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787832924.933305:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787832924.933956:0:14430:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787832924.934168:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787832924.934191:0:14416:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.134@tcp' 00000020:01000004:2.0:1787832924.934193:0:14416:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787832924.934227:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.134@tcp (typ=mgc) 00000020:00000080:2.0:1787832924.934240:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.134@tcp (ffff8c3442963370) 00000020:00000080:2.0:1787832924.934257:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787832924.934338:0:14416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3573932800@MGC192.168.201.134@tcp: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787832924.934545:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.134@tcp-0 is initialized 00000040:01000000:2.0:1787832924.934552:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787832924.938464:0:14431:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787832924.938558:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.134@tcp (uuid ea647735-d55a-4124-bae8-f7db9715e04e) 00000020:00000080:3.0:1787832924.938585:0:14416:0:(genops.c:1385:class_connect()) connect: client ea647735-d55a-4124-bae8-f7db9715e04e, cookie 0x72bd9178b14b7c2a 00000100:00080000:3.0:1787832924.938599:0:14416:0:(import.c:510:import_select_connection()) MGC192.168.201.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832924.938606:0:14416:0:(import.c:624:import_select_connection()) MGC192.168.201.134@tcp: import ffff8c3573932800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832924.938638:0:14416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3565b6ed00 x1874678300888704/t0(0) o250->MGC192.168.201.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787832924.938670:0:14416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ea647735-d55a-4124-bae8-f7db9715e04e->MGS 00000020:01000004:3.0:1787832924.938692:0:14416:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787832924.938697:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787832924.938740:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c35654799b8) 00000020:00000080:3.0:1787832924.938753:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787832924.938778:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea647735-d55a-4124-bae8-f7db9715e04e:3304:1874678300888704:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787832924.938861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832924.938950:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300888704 00000100:00100000:0.0:1787832924.938957:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300888704 00000100:00100000:0.0:1787832924.938988:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832924.938995:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874678300888704:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787832924.939599:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ea647735-d55a-4124-bae8-f7db9715e04e@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1787832924.939633:0:14427:0:(genops.c:1385:class_connect()) connect: client ea647735-d55a-4124-bae8-f7db9715e04e, cookie 0x72bd9178b14b7c38 00000100:00080000:0.0:1787832924.939814:0:14427:0:(import.c:65:import_set_state_nolock()) ffff8c3546502800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832924.939886:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+5:3304:x1874678300888704:12345-0@lo:250:mount.lustre.0 Request processed in 890us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832924.939895:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832924.939958:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787832924.939966:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1787832924.939973:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787832924.939978:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787832924.939981:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3573932800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787832924.939984:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787832924.939991:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787832924.939996:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ea647735-d55a-4124-bae8-f7db9715e04e:3304:1874678300888704:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787832924.956594:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832924.959872:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787832924.959882:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787832924.960447:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787832924.960454:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787832924.961089:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787832924.961097:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787832924.962515:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832924.962654:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787832924.962658:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787832924.965061:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787832924.965080:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787832925.005811:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787832925.006031:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787832925.006039:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787832925.007559:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787832925.007570:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787832925.008661:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832925.008856:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787832925.008860:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787832925.011382:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787832925.011399:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787832925.012250:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832925.012438:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787832925.012443:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787832925.013111:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787832925.013118:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787832925.013673:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832925.014036:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787832925.014041:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787832925.014586:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787832925.014598:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787832925.045527:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787832925.045780:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787832925.045788:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787832925.058779:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787832925.058808:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787832925.063227:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787832925.063245:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787832925.066281:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787832925.066316:0:14416:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787832925.066322:0:14416:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787832925.066457:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787832925.066496:0:14416:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787832925.066500:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787832925.066502:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.066503:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.066504:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.066506:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.066507:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.066509:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.066511:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.066512:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.066514:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787832925.066516:0:14416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787832925.066518:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787832925.066519:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.066520:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.066521:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.066522:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.066523:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.066524:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.066525:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.066526:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.066527:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787832925.066556:0:14416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787832925.066580:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300888832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787832925.066679:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.067002:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f05a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.071543:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300888832 00000100:00100000:3.0:1787832925.071561:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300888832 00000100:00100000:3.0:1787832925.071671:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832925.071681:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+5:14416:x1874678300888832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787832925.071781:0:14429:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787832925.071785:0:14429:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787832925.071788:0:14429:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787832925.072242:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787832925.072617:0:14429:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787832925.074527:0:14451:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787832925.074535:0:14451:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787832925.074538:0:14451:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787832925.074570:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787832925.075033:0:14429:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787832925.075044:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787832925.089882:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+5:14416:x1874678300888832:12345-0@lo:253:mount.lustre.0 Request processed in 18193us (23194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832925.089901:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832925.090044:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300888832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787832925.090063:0:14416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787832925.090067:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787832925.090069:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.090070:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.090071:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.090072:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.090073:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.090075:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.090076:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.090078:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.090079:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787832925.090104:0:14416:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c357b0a7000 from lustre-MDT0000 10000000:01000000:3.0:1787832925.090130:0:14416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787832925.090133:0:14416:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787832925.090139:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c3442963370 10000000:01000000:3.0:1787832925.090143:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787832925.090151:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c3442963370 from 1 10000000:01000000:3.0:1787832925.090154:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787832925.090196:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.090220:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.090231:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832925.090250:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300888960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787832925.090289:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.090370:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832925.090408:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300888960 00000100:00100000:0.0:1787832925.090414:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300888960 00000100:00100000:0.0:1787832925.090488:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832925.090498:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+5:14416:x1874678300888960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832925.090511:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832925.090526:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031c00/0x72bd9178b14b7c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7c3f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832925.090550:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031c00/0x72bd9178b14b7c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7c3f expref: 6 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832925.090562:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031c00/0x72bd9178b14b7c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7c3f expref: 6 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832925.090571:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031c00, rc 0) 00000100:00100000:0.0:1787832925.090663:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+6:14416:x1874678300888960:12345-0@lo:101:mount.lustre.0 Request processed in 166us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832925.090669:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787832925.090808:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300888960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832925.090820:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.090829:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832925.090874:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832925.090901:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.090998:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889088 00000100:00100000:3.0:1787832925.091003:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889088 00000100:00100000:3.0:1787832925.091036:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832925.091044:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+6:14416:x1874678300889088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787832925.091239:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+6:14416:x1874678300889088:12345-0@lo:501:mount.lustre.0 Request processed in 196us (337us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832925.091246:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832925.091328:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35493d3480 going to sleep for 11 seconds 00000100:00100000:1.0:1787832925.091340:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787832925.091365:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787832925.091383:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091390:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832925.091397:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c357b0a7000 10000000:01000000:1.0:1787832925.091400:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787832925.091408:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c357b0a7000 10000000:01000000:1.0:1787832925.091411:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787832925.091413:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c357b0a7000 from 1 10000000:01000000:1.0:1787832925.091415:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787832925.091430:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091437:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091443:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832925.091454:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787832925.091478:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832925.091497:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35493d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.091580:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889216 00000100:00100000:3.0:1787832925.091584:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889216 00000100:00100000:3.0:1787832925.091612:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832925.091619:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+6:14416:x1874678300889216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787832925.091626:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832925.091638:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87c00/0x72bd9178b14b7c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7c4d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.091651:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87c00/0x72bd9178b14b7c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7c4d expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.091671:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87c00/0x72bd9178b14b7c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7c4d expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.091678:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87c00, rc 0) 00000100:00100000:3.0:1787832925.091740:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+7:14416:x1874678300889216:12345-0@lo:101:mount.lustre.0 Request processed in 122us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.091746:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832925.091838:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832925.091848:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c54 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091855:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7c54 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832925.091864:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787832925.091914:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c54 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091921:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40a00/0x72bd9178b14b7c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c54 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832925.091945:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787832925.091948:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787832925.091952:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c357b0a7000 10000000:01000000:1.0:1787832925.091955:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787832925.091957:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787832925.091959:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787832925.091974:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091980:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.091986:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832925.091996:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787832925.092019:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832925.092044:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35493d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.092145:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889344 00000100:00100000:3.0:1787832925.092149:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889344 00000100:00100000:3.0:1787832925.092181:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832925.092188:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+7:14416:x1874678300889344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787832925.092194:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832925.092201:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87e00/0x72bd9178b14b7c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7c5b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.092214:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87e00/0x72bd9178b14b7c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7c5b expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.092221:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87e00/0x72bd9178b14b7c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7c5b expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.092227:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87e00, rc 0) 00000100:00100000:3.0:1787832925.092251:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+8:14416:x1874678300889344:12345-0@lo:101:mount.lustre.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.092256:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787832925.092319:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832925.092329:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c62 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832925.092337:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7c62 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832925.092370:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832925.092394:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832925.092422:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35493d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832925.092619:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889472 00000100:00100000:0.0:1787832925.092624:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889472 00000100:00100000:0.0:1787832925.092656:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787832925.092663:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+8:14416:x1874678300889472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832925.093015:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+9:14416:x1874678300889472:12345-0@lo:501:mount.lustre.0 Request processed in 353us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832925.093022:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787832925.093255:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832925.093287:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787832925.093337:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832925.093362:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35493d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.093409:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889600 00000100:00100000:3.0:1787832925.093413:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889600 00000100:00100000:3.0:1787832925.093450:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787832925.093456:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+9:14416:x1874678300889600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787832925.093786:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+9:14416:x1874678300889600:12345-0@lo:503:mount.lustre.0 Request processed in 330us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.093793:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787832925.094230:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300889600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832925.094670:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14452:1874678300889728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832925.094766:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832925.094803:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357b786b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787832925.094865:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300889728 00000100:00100000:1.0:1787832925.094870:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300889728 00000100:00100000:1.0:1787832925.094905:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787832925.094914:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+9:14452:x1874678300889728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787832925.095359:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+9:14452:x1874678300889728:12345-0@lo:502:llog_process_th.0 Request processed in 446us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832925.095370:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832925.095531:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14452:1874678300889728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787832925.095561:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832925.095574:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832925.095576:0:14452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787832925.095581:0:14452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787832925.095584:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787832925.095600:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c3543790000) 00000020:00000080:0.0:1787832925.095620:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787832925.095627:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787832925.095693:0:14452:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787832925.095905:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7c70 00000020:00000080:1.0:1787832925.096321:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787832925.096326:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832925.096330:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832925.096331:0:14452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787832925.096335:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787832925.096338:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832925.096340:0:14452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787832925.096343:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787832925.096352:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c3550bb99b8) 00000020:00000080:1.0:1787832925.096362:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787832925.096366:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787832925.096368:0:14452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787832925.096371:0:14452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787832925.096376:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787832925.096421:0:14452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357b0a7000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787832925.096432:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c3550bbcd28) 00000020:00000080:1.0:1787832925.096449:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787832925.096501:0:14452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787832925.096507:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b7c85 00000020:00000080:1.0:1787832925.096599:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787832925.096605:0:14452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787832925.096610:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72bd9178b14b7c8c 00080000:01000000:1.0:1787832925.096615:0:14452:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787832925.096619:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7c93 00010000:00010000:3.0:1787832925.214681:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787832925.219151:0:14452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787832925.220405:0:14452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787832925.221070:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c3565478000) 00000020:00000080:3.0:1787832925.221091:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787832925.221174:0:14452:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787832925.221182:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7ca1 00000020:00000080:2.0:1787832925.223045:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787832925.228392:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72bd9178b14b7ca8 00000020:00000080:3.0:1787832925.229019:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787832925.229032:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832925.229040:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.229042:0:14452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787832925.229047:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832925.229054:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.229055:0:14452:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787832925.229059:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787832925.229097:0:14452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787832925.229110:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832925.229114:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.229115:0:14452:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787832925.229118:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787832925.229120:0:14452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787832925.229121:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787832925.229123:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787832925.229125:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787832925.229128:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.229129:0:14452:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787832925.229140:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787832925.229144:0:14452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787832925.229149:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.229150:0:14452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787832925.229153:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787832925.229160:0:14452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:3.0:1787832925.229186:0:14452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787832925.229189:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787832925.229206:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c356547cd28) 00000020:00000080:3.0:1787832925.229220:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787832925.229226:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787832925.229282:0:14452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787832925.229287:0:14452:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787832925.229293:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7cb6 00010000:00080000:3.0:1787832925.229338:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3550787800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1787832925.229569:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787832925.229972:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787832925.230019:0:14452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787832925.231023:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832925.231099:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787832925.231192:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787832925.234801:0:14456:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787832925.234809:0:14456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787832925.236519:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787832925.236540:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787832925.236579:0:14452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787832925.237084:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b7cbd 00000100:00080000:2.0:1787832925.237099:0:14452:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787832925.237107:0:14452:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3550787800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832925.237156:0:14452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c34430ecb40 x1874678300889856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787832925.237240:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300889856:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787832925.237309:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874678300889856 offset 0 length 520: 4 00000100:00080000:2.0:1787832925.237383:0:14452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787832925.237442:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832925.237447:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.237450:0:14452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787832925.237452:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787832925.237455:0:14452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787832925.237456:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787832925.237458:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787832925.237459:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787832925.237461:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.237462:0:14452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787832925.237465:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787832925.237468:0:14452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787832925.237471:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.237473:0:14452:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787832925.237475:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787832925.237479:0:14452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.134@tcp to nid 0x20000c0a8c986 (192.168.201.134@tcp) 00000020:01000000:2.0:1787832925.237500:0:14452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787832925.237503:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787832925.237517:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c3442960000) 00000020:00000080:2.0:1787832925.237530:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787832925.237535:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787832925.237797:0:14452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787832925.237804:0:14452:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787832925.237823:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72bd9178b14b7ccb 00010000:00080000:2.0:1787832925.237860:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c357bb26000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787832925.238083:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787832925.238290:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787832925.238315:0:14452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787832925.243353:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787832925.243451:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787832925.244208:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787832925.244789:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787832925.244795:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787832925.246127:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787832925.246143:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787832925.246181:0:14452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787832925.246205:0:14452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b7cd2 00000100:00080000:3.0:1787832925.246216:0:14452:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832925.246222:0:14452:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c357bb26000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832925.246258:0:14452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3565b6da40 x1874678300889984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787832925.246324:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300889984:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787832925.246391:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874678300889984 offset 0 length 520: 4 00000100:00080000:3.0:1787832925.246448:0:14452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787832925.246649:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832925.246653:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.246655:0:14452:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787832925.246658:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832925.246662:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.246663:0:14452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787832925.246666:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787832925.246667:0:14452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787832925.246670:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832925.246672:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.246673:0:14452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787832925.246675:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787832925.246677:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.246678:0:14452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787832925.246682:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787832925.246748:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14452:1874678300890112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832925.246803:0:14452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.246833:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3565f050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.246896:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890112 00000100:00100000:2.0:1787832925.246906:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890112 00000100:00100000:2.0:1787832925.246955:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787832925.246967:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+9:14452:x1874678300890112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832925.247216:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+9:14452:x1874678300890112:12345-0@lo:502:llog_process_th.0 Request processed in 250us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.247224:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787832925.247435:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14452:1874678300890112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787832925.247461:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787832925.247465:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787832925.247467:0:14452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787832925.247470:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787832925.247759:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787832925.247783:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787832925.247800:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c62 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.247811:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40c00/0x72bd9178b14b7c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c62 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832925.247819:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c357b0a7000 from 1 10000000:01000000:2.0:1787832925.247822:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787832925.247851:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.247859:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.247880:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.247897:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787832925.247930:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.247945:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566075540 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.248142:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890240 00000100:00100000:3.0:1787832925.248147:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890240 00000100:00100000:3.0:1787832925.248174:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787832925.248181:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+9:14416:x1874678300890240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787832925.248191:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832925.248205:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7cd9 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.248235:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 10 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.248245:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 10 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.248254:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86c00, rc 0) 00000100:00100000:3.0:1787832925.248288:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+10:14416:x1874678300890240:12345-0@lo:101:mount.lustre.0 Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.248294:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787832925.248362:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787832925.248375:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.248384:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.248966:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890368:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787832925.249000:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.249024:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3566075540 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.249049:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890368 00000100:00100000:2.0:1787832925.249054:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890368 00000100:00100000:2.0:1787832925.249080:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832925.249087:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+10:14416:x1874678300890368:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787832925.249102:0:14429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787832925.249107:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787832925.249171:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+10:14416:x1874678300890368:12345-0@lo:256:mount.lustre.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.249178:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832925.249211:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890368:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787832925.249797:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787832925.249813:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.249824:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832925.249832:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a7000 from 1 10000000:01000000:2.0:1787832925.249835:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832925.249859:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.249867:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.249875:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.249889:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787832925.249918:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.249933:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356011a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.249954:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890496 00000100:00100000:2.0:1787832925.249958:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890496 00000100:00100000:2.0:1787832925.249982:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832925.249987:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+10:14416:x1874678300890496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787832925.249995:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832925.250008:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7ce7 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.250037:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.250047:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.250056:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610ac00, rc 0) 00000100:00100000:2.0:1787832925.250087:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300890496:12345-0@lo:101:mount.lustre.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.250093:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832925.250126:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787832925.250138:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.250145:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.250188:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832925.250215:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.250227:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356011a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.250241:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890624 00000100:00100000:2.0:1787832925.250245:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890624 00000100:00100000:2.0:1787832925.250266:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832925.250271:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300890624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832925.250660:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300890624:12345-0@lo:501:mount.lustre.0 Request processed in 388us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.250677:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787832925.250746:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832925.250775:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787832925.250816:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.250830:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356011a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.250843:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890752 00000100:00100000:2.0:1787832925.250846:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890752 00000100:00100000:2.0:1787832925.250867:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787832925.250873:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300890752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787832925.251016:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300890752:12345-0@lo:503:mount.lustre.0 Request processed in 142us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.251023:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787832925.251064:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300890752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787832925.251299:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14460:1874678300890880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832925.251336:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.251356:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300890880 00000100:00100000:2.0:1787832925.251360:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300890880 00000100:00100000:2.0:1787832925.251381:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787832925.251389:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14460:x1874678300890880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832925.251551:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14460:x1874678300890880:12345-0@lo:502:llog_process_th.0 Request processed in 163us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832925.251559:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787832925.251590:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832925.251603:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14460:1874678300890880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787832925.251627:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832925.251638:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.251641:0:14460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787832925.251651:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357b0a7000 00000020:00000080:2.0:1787832925.251653:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787832925.251662:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832925.251664:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.251666:0:14460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787832925.251668:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832925.251671:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.251672:0:14460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787832925.251676:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c357b0a7000 00000020:00000080:2.0:1787832925.251678:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787832925.255181:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832925.255192:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.255194:0:14460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787832925.255199:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832925.255203:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832925.255205:0:14460:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787832925.255210:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c357b0a7000 00000020:00000080:2.0:1787832925.255212:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787832925.257902:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14460:1874678300891008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787832925.259146:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.259195:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832925.259247:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891008 00000100:00100000:0.0:1787832925.259254:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891008 00000100:00100000:0.0:1787832925.259305:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787832925.259314:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14460:x1874678300891008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832925.259545:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+11:14460:x1874678300891008:12345-0@lo:502:llog_process_th.0 Request processed in 231us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832925.259553:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787832925.259982:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14460:1874678300891008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787832925.260013:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787832925.260021:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787832925.260023:0:14460:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787832925.260028:0:14460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787832925.263304:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787832925.263343:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787832925.263367:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.263381:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832925.263441:0:14416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787832925.263445:0:14416:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c357b0a7000 10000000:01000000:2.0:1787832925.263448:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c357b0a7000 10000000:01000000:2.0:1787832925.263453:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787832925.263458:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c357b0a7000 from 1 10000000:01000000:2.0:1787832925.263461:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787832925.263499:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.263508:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.263520:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.263546:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787832925.263618:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.263672:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.263682:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891136 00000100:00100000:3.0:1787832925.263691:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891136 00000100:00100000:3.0:1787832925.263784:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787832925.263794:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300891136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787832925.263825:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832925.263841:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b7cfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7cf5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.263870:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b7cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7cf5 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.263883:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86400/0x72bd9178b14b7cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7cf5 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.263894:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86400, rc 0) 00000100:00100000:3.0:1787832925.263955:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891136:12345-0@lo:101:mount.lustre.0 Request processed in 163us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.263963:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787832925.265807:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787832925.265835:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cfc expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.265848:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7cfc expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.265927:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832925.265985:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.266041:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.266838:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891264 00000100:00100000:3.0:1787832925.266845:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891264 00000100:00100000:3.0:1787832925.266886:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787832925.266895:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787832925.267165:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891264:12345-0@lo:501:mount.lustre.0 Request processed in 270us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.267174:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787832925.267467:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832925.267516:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787832925.267566:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.267616:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.267655:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891392 00000100:00100000:3.0:1787832925.267660:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891392 00000100:00100000:3.0:1787832925.267691:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787832925.267698:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787832925.267896:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891392:12345-0@lo:503:mount.lustre.0 Request processed in 197us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.267904:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787832925.268038:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832925.268879:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14465:1874678300891520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832925.268927:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832925.271171:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.271228:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891520 00000100:00100000:3.0:1787832925.271236:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891520 00000100:00100000:3.0:1787832925.271287:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787832925.271297:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14465:x1874678300891520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832925.271647:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14465:x1874678300891520:12345-0@lo:502:llog_process_th.0 Request processed in 351us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.271655:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787832925.272225:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14465:1874678300891520:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787832925.272293:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787832925.272309:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c35437919b8) 00000020:00000080:0.0:1787832925.272329:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787832925.272653:0:14465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c357b0a7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787832925.272658:0:14465:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c357b0a7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787832925.272660:0:14465:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c357b0a7000 4 00010000:00080000:0.0:1787832925.272689:0:14465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3549734000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.134@tcp at head 00010000:00010000:0.0:1787832925.274995:0:14465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787832925.275252:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787832925.275285:0:14465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787832925.275300:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72bd9178b14b7d0a 00000100:00080000:0.0:1787832925.275309:0:14465:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787832925.275314:0:14465:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c3549734000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787832925.275359:0:14465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c35465dc780 x1874678300891648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787832925.275399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300891648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787832925.275478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787832925.275536:0:14465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787832925.275680:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891648 00000100:00100000:1.0:1787832925.275691:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891648 00000100:00100000:1.0:1787832925.275866:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832925.275874:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874678300891648:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787832925.275944:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874678300891648:12345-0@lo:38:llog_process_th.0 Request processed in 69us (465us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787832925.275953:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832925.278173:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832925.278192:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3549734000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787832925.278199:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787832925.278203:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300891648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787832925.278511:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14465:1874678300891776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787832925.278663:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832925.278760:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357c674c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.278813:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891776 00000100:00100000:3.0:1787832925.278819:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891776 00000100:00100000:3.0:1787832925.278860:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787832925.278870:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14465:x1874678300891776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787832925.279163:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14465:x1874678300891776:12345-0@lo:502:llog_process_th.0 Request processed in 293us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.279176:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787832925.279242:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ea647735-d55a-4124-bae8-f7db9715e04e:14465:1874678300891776:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787832925.279264:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787832925.279462:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787832925.279480:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787832925.279497:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cfc expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.279506:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610be00/0x72bd9178b14b7cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7cfc expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787832925.279552:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787832925.279554:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.279556:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.279557:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.279559:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.279560:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.279562:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.279563:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.279566:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.279567:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787832925.279572:0:14416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787832925.279574:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787832925.279576:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.279577:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.279579:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.279580:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.279581:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.279582:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.279583:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.279584:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.279585:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787832925.279667:0:14416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787832925.279679:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787832925.284132:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.284185:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.284229:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300891904 00000100:00100000:3.0:1787832925.284237:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300891904 00000100:00100000:3.0:1787832925.284285:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787832925.284293:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+12:14416:x1874678300891904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787832925.284404:0:14427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787832925.284419:0:14427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787832925.335224:0:14427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787832925.335243:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787832925.335524:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787832925.335529:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787832925.335551:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.335571:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.335580:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.335629:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832925.335644:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 12 pid: 14428 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832925.335658:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300892032:0@lo:104: 00000100:00100000:2.0:1787832925.335755:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832925.335794:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832925.335867:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892032 00000100:00100000:3.0:1787832925.335874:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892032 00000100:00100000:3.0:1787832925.335950:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832925.335960:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300892032:12345-0@lo:104: 00010000:00010000:3.0:1787832925.335971:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336029:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832925.336035:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300892032:12345-0@lo:104: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.336042:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787832925.336405:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832925.336412:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336420:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832925.336424:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336433:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832925.336458:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832925.336463:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832925.336529:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336536:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832925.336556:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336563:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ce0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336579:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832925.336581:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832925.336636:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832925.336662:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300892160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787832925.336694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832925.336779:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892160 00000100:00100000:3.0:1787832925.336783:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892160 00010000:00010000:3.0:1787832925.336800:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 13 pid: 14428 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832925.336820:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832925.336827:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea647735-d55a-4124-bae8-f7db9715e04e+13:3306:x1874678300892160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832925.336836:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832925.336841:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 13 pid: 14428 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336857:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 13 pid: 14428 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336874:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336882:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787832925.336895:0:14419:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001366167s 00010000:00010000:3.0:1787832925.336899:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336906:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336912:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336918:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336923:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610ae00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832925.336928:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336934:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336942:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.336955:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832925.336980:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea647735-d55a-4124-bae8-f7db9715e04e+13:3306:x1874678300892160:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832925.336987:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787832925.337144:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7cd9 expref: 12 pid: 14428 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832925.337155:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300892032:0@lo:104: 00010000:00010000:3.0:1787832925.337171:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.337179:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.337185:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832925.337191:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356610ae00/0x72bd9178b14b7d11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832925.337214:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300892160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832925.344060:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+11:14416:x1874678300891904:12345-0@lo:253:mount.lustre.0 Request processed in 59759us (59929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832925.344074:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787832925.344216:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:14416:1874678300891904:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787832925.344231:0:14416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787832925.344235:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787832925.344236:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787832925.344238:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832925.344239:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832925.344241:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832925.344254:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832925.344255:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787832925.344257:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787832925.344258:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832925.344260:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787832925.344273:0:14416:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787832925.347486:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.347623:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832925.348495:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.348643:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832925.348969:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.349230:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832925.350268:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.350477:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832925.350842:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.351540:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787832925.352142:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787832925.352299:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787832925.377670:0:14416:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787832925.378246:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787832925.378573:0:14472:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787832925.378577:0:14472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787832925.378772:0:14473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787832925.378845:0:14473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787832925.382574:0:14473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787832925.382770:0:14473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787832925.382775:0:14473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787832925.386304:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787832925.386522:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787832925.387411:0:14416:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787832925.387421:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787832925.387566:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787832925.389312:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787832925.390320:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787832925.390424:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787832925.391225:0:14416:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1787832925.392312:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787832925.399117:0:14416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787832925.429219:0:14416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787832925.429257:0:14416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9aa481d4b988 00100000:10000000:0.0:1787832925.429267:0:14416:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787832925.430344:0:14416:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787832925.430360:0:14416:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787832925.430375:0:14416:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787832925.430399:0:14416:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787832925.966486:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787832926.348963:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787832926.348971:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c357b0a7000 from 6 10000000:01000000:1.0:1787832926.348977:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787832926.349029:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832926.349043:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832926.349055:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832926.349087:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300892288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832926.349168:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832926.349233:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356032ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832926.349459:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892288 00000100:00100000:3.0:1787832926.349481:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892288 00000100:00100000:3.0:1787832926.349541:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787832926.349551:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+11:14431:x1874678300892288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832926.349564:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832926.349577:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d18 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832926.349603:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832926.349613:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832926.349622:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86c00, rc 0) 00000100:00100000:3.0:1787832926.349674:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300892288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832926.349682:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787832926.350853:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300892288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832926.350876:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832926.350887:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832926.350954:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300892416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787832926.351001:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832926.351030:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35491d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832926.351108:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892416 00000100:00100000:1.0:1787832926.351114:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892416 00000100:00100000:1.0:1787832926.351157:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832926.351165:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300892416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787832926.351182:0:14429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787832926.351199:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787832926.351202:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787832926.351289:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300892416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832926.351319:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787832926.351359:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300892416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787832926.351399:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787832926.351406:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832926.351416:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832926.352364:0:14468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832926.352370:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832926.352844:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787832926.352851:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787832926.988870:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787832927.372503:0:14468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787832927.372513:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832927.373070:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787832927.373137:0:14468:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787832927.373167:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1787832928.018258:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832929.037034:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832929.590926:0:14715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787832930.066550:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787832930.578920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787832930.578927:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787832930.578929:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787832930.578932:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787832930.578935:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787832930.578938:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787832930.578942:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c3549734000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787832930.578954:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c3549734000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787832930.578981:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c357b691a40 x1874678300892672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787832930.579146:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832930.579163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300892544:0@lo:400:kworker.0 00000100:00100000:1.0:1787832930.579237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832930.579347:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892544 00000100:00100000:1.0:1787832930.579356:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892544 00000100:00100000:1.0:1787832930.579418:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787832930.579428:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:3308:x1874678300892544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832930.579485:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:3308:x1874678300892544:12345-0@lo:400:kworker.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832930.579492:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787832930.579542:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300892544:0@lo:400:kworker.0 00000100:00100000:1.0:1787832930.579566:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300892672:0@lo:38:kworker.0 00000100:00100000:1.0:1787832930.579596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832930.580861:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892672 00000100:00100000:0.0:1787832930.580871:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892672 00000100:00100000:0.0:1787832930.580903:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832930.580910:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874678300892672:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787832930.580936:0:14436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:0.0:1787832930.580975:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72bd9178b14b7d26 00000004:00100000:0.0:1787832930.580992:0:14436:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787832930.581139:0:14436:0:(import.c:65:import_set_state_nolock()) ffff8c34418de000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832930.581206:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b691680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874678300892672:12345-0@lo:38:kworker.0 Request processed in 295us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832930.581227:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787832930.581275:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c357b691a40 x1874678300892672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787832930.581293:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787832930.581301:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787832930.581306:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787832930.581309:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3549734000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787832930.581315:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874678300892672:0@lo:38:kworker.0 00010000:00010000:0.0:1787832931.088918:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832932.109021:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787832932.405530:0:14867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcfd972e0 20000000:00000080:0.0:1787832932.405549:0:14867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c357c2a3c00 uarg=0000000000000000 20000000:01000000:0.0:1787832932.405584:0:14867:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787832932.405592:0:14867:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787832932.405598:0:14867:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787832932.407563:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787832932.407903:0:14867:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787832932.415590:0:14867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787832932.415675:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.415698:0:14867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.415722:0:14867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.415775:0:14867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.415792:0:14867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 11 pid: 14429 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832932.415807:0:14867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b692d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14867:1874678300892800:0@lo:104: 00000100:00100000:1.0:1787832932.415887:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832932.415948:0:14867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832932.415982:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892800 00000100:00100000:3.0:1787832932.415993:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892800 00000100:00100000:3.0:1787832932.416076:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832932.416086:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14867:x1874678300892800:12345-0@lo:104: 00010000:00010000:3.0:1787832932.416100:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832932.416171:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787832932.416177:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14867:x1874678300892800:12345-0@lo:104: Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832932.416185:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832932.416396:0:14867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b692d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14867:1874678300892800:0@lo:104: 00010000:00010000:1.0:1787832932.416419:0:14867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.416536:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832932.416544:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.416552:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832932.416557:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.416567:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832932.416586:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832932.416592:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787832932.416638:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.416645:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832932.416680:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.416689:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c356610a200/0x72bd9178b14b7ce7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7cee expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832932.416723:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300892928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787832932.416726:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832932.416729:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832932.416731:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832932.416758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832932.419499:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300892928 00000100:00100000:0.0:1787832932.419513:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300892928 00010000:00010000:0.0:1787832932.419561:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 12 pid: 14429 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832932.419617:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832932.419629:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea647735-d55a-4124-bae8-f7db9715e04e+12:3308:x1874678300892928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787832932.419646:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832932.419653:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 12 pid: 14429 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419667:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 12 pid: 14429 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419725:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356610ac00/0x72bd9178b14b7cee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7ce7 expref: 12 pid: 14429 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419749:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419760:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419780:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419789:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419797:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419804:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419811:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832932.419816:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419826:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419848:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832932.419871:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832932.419912:0:14867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.419923:0:14867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832932.419930:0:14867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40400/0x72bd9178b14b7d2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832932.419952:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ea647735-d55a-4124-bae8-f7db9715e04e+11:3308:x1874678300892928:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832932.419962:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832932.420014:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300892928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787832933.132140:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832934.156290:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787832934.412001:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787832934.412010:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a7000 from 10 10000000:01000000:1.0:1787832934.412015:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832934.412069:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832934.412082:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832934.412093:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832934.412120:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832934.412204:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832934.412277:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3550841300 going to sleep for 11 seconds 00000100:00100000:2.0:1787832934.412333:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893056 00000100:00100000:2.0:1787832934.412341:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893056 00000100:00100000:2.0:1787832934.412396:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787832934.412405:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+11:14431:x1874678300893056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832934.412420:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832934.412435:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d34 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832934.412461:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832934.412473:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832934.412500:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a200, rc 0) 00000100:00100000:2.0:1787832934.412553:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300893056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832934.412561:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832934.412761:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832934.412791:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832934.412804:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832934.412867:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832934.412898:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832934.412933:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55180 going to sleep for 11 seconds 00000100:00100000:1.0:1787832934.413043:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893184 00000100:00100000:1.0:1787832934.413048:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893184 00000100:00100000:1.0:1787832934.413084:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787832934.413101:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300893184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787832934.413349:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300893184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832934.413358:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787832934.413443:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832934.413472:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832934.413510:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832934.413591:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c357af55180 going to sleep for 11 seconds 00000100:00100000:1.0:1787832934.414475:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893312 00000100:00100000:1.0:1787832934.414482:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893312 00000100:00100000:1.0:1787832934.414524:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787832934.414888:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300893312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787832934.415131:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:14431:x1874678300893312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832934.415235:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300893312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787832934.416451:0:14946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787832934.416890:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787832934.416907:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787832934.416926:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832934.416937:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832934.418052:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787832935.180942:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787832935.692288:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787832935.692297:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787832935.692300:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787832935.692304:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787832935.692370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea647735-d55a-4124-bae8-f7db9715e04e:3305:1874678300893440:0@lo:400:kworker.0 00000100:00100000:1.0:1787832935.692621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832935.692694:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832935.692722:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300893568:0@lo:400:kworker.0 00000100:00100000:1.0:1787832935.692754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832935.692939:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893440 00000100:00100000:0.0:1787832935.692949:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893440 00000100:00100000:0.0:1787832935.693008:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787832935.693020:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:3305:x1874678300893440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832935.693098:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893568 00000100:00100000:1.0:1787832935.693102:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893568 00000100:00100000:1.0:1787832935.693136:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832935.693144:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300893568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832935.693380:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832925/real 1787832925] req@ffff8c3565b6da40 x1874678300889984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832935.693431:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c3565b6da40 x1874678300889984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832935.693499:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832925/real 1787832925] req@ffff8c34430ecb40 x1874678300889856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832935 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832935.693512:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c34430ecb40 x1874678300889856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832935 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787832935.693527:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787832935.693551:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787832935.693555:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300889984:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787832935.693560:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3550787800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787832935.693564:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787832935.693567:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300889856:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787832935.697060:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:3305:x1874678300893440:12345-0@lo:400:kworker.0 Request processed in 4033us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832935.697078:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787832935.697143:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787832935.697149:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787832935.697152:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c3550787800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787832935.697158:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1787832935.697164:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787832935.697192:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3550787800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787832935.697236:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c35465dda40 x1874678300893696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787832935.697259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787832935.697262:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787832935.697264:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787832935.697267:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1787832935.697269:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787832935.697273:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c357bb26000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:0.0:1787832935.697284:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c35465de1c0 x1874678300893824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787832935.697314:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300893696:0@lo:8:kworker.0 00000400:00000100:0.0:1787832935.697358:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874678300893696 offset 0 length 520: 4 00000100:00100000:0.0:1787832935.697390:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300893824:0@lo:8:kworker.0 00000400:00000100:0.0:1787832935.697409:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874678300893824 offset 0 length 520: 4 00000100:00100000:1.0:1787832935.697924:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300893568:12345-0@lo:400:kworker.0 Request processed in 4778us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832935.697934:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787832935.698927:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c35465dc780 x1874678300893568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832935.698946:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300893568:0@lo:400:kworker.0 00000100:00100000:0.0:1787832935.698961:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ea647735-d55a-4124-bae8-f7db9715e04e:3305:1874678300893440:0@lo:400:kworker.0 00010000:00010000:2.0:1787832936.220233:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832937.232036:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787832937.506455:0:15115:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787832937.506459:0:15115:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787832937.506588:0:15115:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3542f87800 00000020:01000004:3.0:1787832937.506604:0:15115:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787832937.506615:0:15115:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787832937.506643:0:15115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c356afa99b8) 00000020:00000080:3.0:1787832937.506663:0:15115:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787832937.560613:0:15115:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787832937.563295:0:15115:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787832937.564507:0:15115:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787832937.565033:0:15115:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787832937.565309:0:15115:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787832937.565911:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787832937.565995:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787832937.566128:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787832937.567944:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:2.0:1787832937.568317:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1787832937.568573:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1787832937.570294:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:2.0:1787832937.570582:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:2.0:1787832937.572229:0:15115:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00000020:00000080:2.0:1787832937.577205:0:15115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787832937.577220:0:15115:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787832937.577232:0:15115:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bd9178b14b7d49 00000020:01000004:2.0:1787832937.577242:0:15115:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787832937.577277:0:15115:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787832937.577281:0:15115:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787832937.577287:0:15115:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787832937.577292:0:15115:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787832937.577307:0:15115:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c34429619b8) 00000020:00000080:2.0:1787832937.577317:0:15115:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787832937.580996:0:15115:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832937.581418:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787832937.581423:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787832937.582237:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787832937.582245:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787832937.585873:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787832937.585882:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787832937.587635:0:15115:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787832937.587834:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787832937.587841:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787832937.588740:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787832937.588747:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000040:00080000:3.0:1787832937.616925:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787832937.620506:0:15115:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832937.620815:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787832937.620823:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787832937.623057:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787832937.623070:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787832937.627103:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787832937.627117:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787832937.632180:0:15115:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832937.632374:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787832937.632380:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787832937.633515:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787832937.633524:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787832937.668012:0:15115:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787832937.668193:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787832937.668198:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787832937.673314:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787832937.673335:0:15115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787832937.675220:0:15115:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787832937.675246:0:15115:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787832937.675253:0:15115:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787832937.692526:0:15115:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787832937.692566:0:15115:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.134@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787832937.692570:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787832937.692572:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787832937.692574:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832937.692575:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832937.692576:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832937.692578:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832937.692579:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832937.692581:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832937.692582:0:15115:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787832937.692586:0:15115:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787832937.692589:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787832937.692590:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787832937.692591:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832937.692592:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832937.692593:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832937.692594:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832937.692595:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832937.692601:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832937.692602:0:15115:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787832937.692643:0:15115:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787832937.692666:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300893952:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787832937.692785:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832937.692847:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354520fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787832937.692928:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300893952 00000100:00100000:2.0:1787832937.692937:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300893952 00000100:00100000:2.0:1787832937.692994:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787832937.693006:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:15115:x1874678300893952:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787832937.693047:0:14429:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787832937.693050:0:14429:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787832937.693054:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787832937.706745:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:15115:x1874678300893952:12345-0@lo:253:mount.lustre.0 Request processed in 13700us (13918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.706761:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787832937.707646:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300893952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787832937.707666:0:15115:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787832937.707669:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787832937.707671:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787832937.707672:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832937.707674:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832937.707675:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832937.707676:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832937.707677:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832937.707679:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832937.707694:0:15115:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787832937.708247:0:15115:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3542f87800 from lustre-OST0000 10000000:01000000:2.0:1787832937.708275:0:15115:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787832937.708278:0:15115:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787832937.708286:0:15115:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c3442963370 local copy 00010000:00010000:2.0:1787832937.708299:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832937.708628:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832937.708690:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832937.708903:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356af82780 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.709011:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894080 00000100:00100000:0.0:1787832937.709017:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894080 00000100:00100000:0.0:1787832937.709102:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787832937.709118:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:15115:x1874678300894080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.709320:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+12:15115:x1874678300894080:12345-0@lo:501:mount.lustre.0 Request processed in 203us (629us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787832937.709328:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787832937.709414:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787832937.709430:0:15115:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787832937.709594:0:15115:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787832937.709603:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.709613:0:15115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832937.709637:0:15115:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3542f87800 10000000:01000000:2.0:1787832937.709641:0:15115:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787832937.709646:0:15115:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c3442963370 10000000:01000000:2.0:1787832937.709649:0:15115:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787832937.709653:0:15115:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c3442963370 from 1 10000000:01000000:2.0:1787832937.709656:0:15115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787832937.709687:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.709696:0:15115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.709904:0:15115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832937.710044:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787832937.710081:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.710141:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356032e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832937.710179:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894208 00000100:00100000:1.0:1787832937.710184:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894208 00000100:00100000:1.0:1787832937.710251:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787832937.710260:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+12:15115:x1874678300894208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832937.710270:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832937.710287:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41200/0x72bd9178b14b7d5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d57 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.710312:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41200/0x72bd9178b14b7d5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d57 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.710324:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41200/0x72bd9178b14b7d5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d57 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.710333:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41200, rc 0) 00000100:00100000:1.0:1787832937.710377:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+13:15115:x1874678300894208:12345-0@lo:101:mount.lustre.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.710383:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787832937.710452:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832937.710466:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d5e expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.710477:0:15115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d5e expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832937.710495:0:15115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787832937.710522:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d5e expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.710530:0:15115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610b400/0x72bd9178b14b7d57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d5e expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832937.710537:0:15115:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787832937.710541:0:15115:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787832937.710546:0:15115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787832937.710548:0:15115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787832937.710565:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.710572:0:15115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.710579:0:15115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832937.710600:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787832937.710627:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.710966:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787832937.711024:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894336 00000100:00100000:3.0:1787832937.711029:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894336 00000100:00100000:3.0:1787832937.711056:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787832937.711063:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+13:15115:x1874678300894336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787832937.711070:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832937.711080:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b7d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d65 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.711096:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b7d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d65 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.711105:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87400/0x72bd9178b14b7d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d65 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.711113:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87400, rc 0) 00000100:00100000:3.0:1787832937.711151:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894336:12345-0@lo:101:mount.lustre.0 Request processed in 89us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.711157:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787832937.711235:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832937.711247:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d6c expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.711255:0:15115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d6c expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832937.711925:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787832937.712758:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832937.713005:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787832937.713049:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787832937.713084:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787832937.713130:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787832937.713162:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787832937.713187:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787832937.713239:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787832937.713245:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787832937.713321:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.713378:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.713409:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832937.713635:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894464 00000100:00100000:3.0:1787832937.713641:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894464 00000100:00100000:3.0:1787832937.713680:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787832937.713689:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787832937.714025:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894464:12345-0@lo:501:mount.lustre.0 Request processed in 336us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.714040:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787832937.714313:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.714355:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832937.714393:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.714473:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832937.714551:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894592 00000100:00100000:2.0:1787832937.714556:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894592 00000100:00100000:3.0:1787832937.714723:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787832937.714733:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787832937.715022:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894592:12345-0@lo:503:mount.lustre.0 Request processed in 290us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.715029:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787832937.715108:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787832937.715698:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787832937.715781:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832937.715824:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.716157:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832937.716230:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894720 00000100:00100000:1.0:1787832937.716236:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894720 00000100:00100000:1.0:1787832937.716263:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787832937.716276:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832937.716537:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894720:12345-0@lo:502:mount.lustre.0 Request processed in 261us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.716544:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787832937.716654:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787832937.717029:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787832937.717076:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787832937.717105:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787832937.717146:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787832937.717179:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787832937.717213:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787832937.717271:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787832937.717303:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787832937.717329:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787832937.717370:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787832937.717402:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787832937.717440:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787832937.717473:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832937.717535:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.717624:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787832937.717666:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894848 00000100:00100000:3.0:1787832937.717672:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894848 00000100:00100000:3.0:1787832937.717917:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787832937.717927:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787832937.718102:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894848:12345-0@lo:502:mount.lustre.0 Request processed in 177us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.718109:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787832937.718233:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787832937.718317:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787832937.718330:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787832937.719285:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787832937.719295:0:15129:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787832937.719302:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832937.719305:0:15129:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787832937.719311:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787832937.719326:0:15129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c3442964d28) 00000020:00000080:2.0:1787832937.719352:0:15129:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787832937.719358:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787832937.719443:0:15129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3542f87800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787832937.719452:0:15129:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787832937.719461:0:15129:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72bd9178b14b7d7a 00010000:00010000:2.0:1787832937.723633:0:15129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787832937.724240:0:15129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1787832937.726466:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787832937.727875:0:15129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787832937.727888:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.727895:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.727897:0:15129:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787832937.727901:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787832937.727904:0:15129:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787832937.727913:0:15129:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787832937.727916:0:15129:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787832937.727917:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787832937.727920:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.727921:0:15129:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787832937.727924:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832937.727927:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.727929:0:15129:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787832937.727931:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787832937.727933:0:15129:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787832937.727935:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.727937:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.727939:0:15129:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787832937.727941:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832937.727943:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.727945:0:15129:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787832937.727948:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787832937.728010:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.728013:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.728015:0:15129:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787832937.728018:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787832937.728289:0:15115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787832937.728315:0:15115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787832937.728345:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d6c expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.728356:0:15115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c3540031e00/0x72bd9178b14b7d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d6c expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787832937.728378:0:15115:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3542f87800 from 1 10000000:01000000:2.0:1787832937.728380:0:15115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832937.728423:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.728432:0:15115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832937.728445:0:15115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832937.728476:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787832937.728566:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832937.728610:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356af829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832937.728859:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300894976 00000100:00100000:1.0:1787832937.728869:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300894976 00000100:00100000:1.0:1787832937.728926:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787832937.728937:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+14:15115:x1874678300894976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832937.728950:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832937.728963:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d81 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.728991:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.729004:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.729015:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832937.729074:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300894976:12345-0@lo:101:mount.lustre.0 Request processed in 140us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.729082:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787832937.729182:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300894976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832937.729199:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.729208:0:15115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832937.729839:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787832937.730138:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832937.730376:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787832937.730421:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787832937.730482:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787832937.730497:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787832937.730579:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.730636:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.730690:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832937.730853:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895104 00000100:00100000:2.0:1787832937.730861:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895104 00000100:00100000:2.0:1787832937.730902:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787832937.730911:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832937.731095:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895104:12345-0@lo:501:mount.lustre.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832937.731104:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787832937.732877:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.732970:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832937.733046:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.733085:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354859da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832937.733318:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895232 00000100:00100000:2.0:1787832937.733325:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895232 00000100:00100000:2.0:1787832937.734768:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787832937.734787:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787832937.735025:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895232:12345-0@lo:503:mount.lustre.0 Request processed in 244us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832937.735044:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787832937.735273:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895232:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787832937.736302:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787832937.736394:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787832937.736471:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.740996:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354649e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787832937.741064:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895360 00000100:00100000:1.0:1787832937.741075:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895360 00000100:00100000:1.0:1787832937.741126:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787832937.741136:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832937.741386:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895360:12345-0@lo:502:mount.lustre.0 Request processed in 251us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.741404:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787832937.741536:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787832937.741933:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787832937.741997:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787832937.742046:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787832937.742082:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787832937.742112:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787832937.742156:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787832937.742204:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787832937.742237:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787832937.742280:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787832937.742331:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.742348:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354649e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.742429:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895488 00000100:00100000:0.0:1787832937.742434:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895488 00000100:00100000:0.0:1787832937.742463:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787832937.742471:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832937.742645:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895488:12345-0@lo:502:mount.lustre.0 Request processed in 174us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.742652:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787832937.742913:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787832937.743013:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787832937.743024:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787832937.744106:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832937.744116:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.744119:0:15133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787832937.744125:0:15133:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3542f87800 00000020:00000080:0.0:1787832937.744128:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832937.744136:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.744138:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.744139:0:15133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787832937.744141:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832937.744144:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.744145:0:15133:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787832937.744148:0:15133:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3542f87800 00000020:00000080:0.0:1787832937.744150:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832937.744240:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.744250:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.744252:0:15133:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787832937.744254:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832937.744257:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.744258:0:15133:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787832937.744261:0:15133:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3542f87800 00000020:00000080:0.0:1787832937.744263:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832937.745308:0:15133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832937.745316:0:15133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832937.745317:0:15133:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787832937.745322:0:15133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787832937.750284:0:15115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787832937.750328:0:15115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787832937.750808:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.750822:0:15115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832937.750874:0:15115:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787832937.750877:0:15115:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3542f87800 10000000:01000000:3.0:1787832937.750880:0:15115:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3542f87800 10000000:01000000:3.0:1787832937.750885:0:15115:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787832937.750892:0:15115:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3542f87800 from 1 10000000:01000000:3.0:1787832937.750895:0:15115:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787832937.750934:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.750943:0:15115:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.750957:0:15115:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832937.750997:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787832937.751069:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.751116:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354649e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.753335:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895616 00000100:00100000:0.0:1787832937.753351:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895616 00000100:00100000:0.0:1787832937.753406:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787832937.753417:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300895616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832937.753436:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832937.753458:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540031800/0x72bd9178b14b7d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7d8f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.753492:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540031800/0x72bd9178b14b7d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7d8f expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.753504:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540031800/0x72bd9178b14b7d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d8f expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.753523:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031800, rc 0) 00000100:00100000:0.0:1787832937.753615:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300895616:12345-0@lo:101:mount.lustre.0 Request processed in 200us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.753622:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787832937.753859:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832937.753892:0:15115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d96 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.753902:0:15115:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7d96 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832937.754461:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787832937.754823:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832937.755072:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787832937.755123:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787832937.755159:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787832937.755220:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787832937.755262:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787832937.755313:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787832937.755350:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787832937.755383:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787832937.755428:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787832937.755463:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787832937.755500:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787832937.755567:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787832937.755624:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787832937.755656:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787832937.755731:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787832937.755771:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787832937.755806:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787832937.755854:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787832937.755889:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787832937.755920:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787832937.755964:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787832937.755999:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787832937.756032:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787832937.756078:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787832937.756125:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787832937.756160:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787832937.756211:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787832937.756248:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787832937.756337:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787832937.756346:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787832937.756454:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.756541:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.756593:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832937.757044:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895744 00000100:00100000:3.0:1787832937.757053:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895744 00000100:00100000:3.0:1787832937.757121:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787832937.757131:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300895744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787832937.757379:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300895744:12345-0@lo:501:mount.lustre.0 Request processed in 248us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.757388:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787832937.760256:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832937.760326:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832937.760401:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.760441:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.760464:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300895872 00000100:00100000:0.0:1787832937.760471:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300895872 00000100:00100000:0.0:1787832937.760537:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787832937.760547:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300895872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832937.762969:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300895872:12345-0@lo:503:mount.lustre.0 Request processed in 2412us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.762987:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787832937.765891:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300895872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787832937.766658:0:15115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787832937.766871:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787832937.766953:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832937.767009:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356af82780 going to sleep for 11 seconds 00000100:00100000:1.0:1787832937.767155:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896000 00000100:00100000:1.0:1787832937.767163:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896000 00000100:00100000:1.0:1787832937.767211:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787832937.767220:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300896000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832937.767867:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300896000:12345-0@lo:502:mount.lustre.0 Request processed in 645us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.767877:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787832937.774431:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787832937.774803:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787832937.774872:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787832937.774909:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787832937.774984:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787832937.775023:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787832937.775073:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787832937.775110:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787832937.775145:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787832937.775195:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787832937.775232:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787832937.775267:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787832937.775316:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787832937.775353:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787832937.775386:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787832937.775434:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787832937.775474:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787832937.775523:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787832937.775574:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787832937.775611:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787832937.775667:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787832937.775742:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787832937.775795:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787832937.775829:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787832937.775890:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787832937.775927:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787832937.775960:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787832937.776008:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787832937.776044:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787832937.776080:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787832937.776130:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787832937.776166:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787832937.776201:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787832937.776235:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787832937.776283:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787832937.776318:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787832937.776383:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787832937.776420:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787832937.776453:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787832937.776503:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787832937.776555:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787832937.776612:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787832937.776698:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832937.776784:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356af82780 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.776900:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896128 00000100:00100000:0.0:1787832937.776908:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896128 00000100:00100000:0.0:1787832937.776963:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787832937.776971:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300896128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832937.777205:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300896128:12345-0@lo:502:mount.lustre.0 Request processed in 233us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.777212:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787832937.780144:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787832937.780280:0:15115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787832937.780296:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787832937.784373:0:15138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787832937.784392:0:15138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c35738a19b8) 00000020:00000080:2.0:1787832937.784413:0:15138:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787832937.784500:0:15138:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3542f87800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787832937.784515:0:15138:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3542f87800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787832937.784518:0:15138:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3542f87800 3 00010000:00080000:2.0:1787832937.784556:0:15138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3566265800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.134@tcp at head 00010000:00010000:2.0:1787832937.787638:0:15138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787832937.787882:0:15138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787832937.787923:0:15138:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787832937.787936:0:15138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72bd9178b14b7da4 00000100:00080000:2.0:1787832937.787947:0:15138:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787832937.787954:0:15138:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c3566265800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832937.788000:0:15138:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c34430ee1c0 x1874678300896256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787832937.788035:0:15138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787832937.788156:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300896256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787832937.788232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.788296:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896256 00000100:00100000:0.0:1787832937.788305:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896256 00000100:00100000:0.0:1787832937.788338:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832937.788346:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874678300896256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787832937.788373:0:14435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1787832937.788401:0:14435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72bd9178b14b7dab 00000004:00100000:0.0:1787832937.788415:0:14435:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787832937.788447:0:14435:0:(import.c:65:import_set_state_nolock()) ffff8c3573a9f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832937.788495:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874678300896256:12345-0@lo:38:llog_process_th.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.788503:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787832937.788560:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c34430ee1c0 x1874678300896256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832937.788571:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832937.788580:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787832937.788588:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787832937.788592:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787832937.788595:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3566265800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787832937.788601:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874678300896256:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787832937.791433:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787832937.791445:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787832937.791447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787832937.791450:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787832937.791556:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300896384:0@lo:400:kworker.0 00000100:00100000:1.0:1787832937.791633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832937.791697:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896384 00000100:00100000:1.0:1787832937.791812:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896384 00000100:00100000:1.0:1787832937.791868:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832937.791878:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300896384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832937.791935:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300896384:12345-0@lo:400:kworker.0 Request processed in 59us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832937.791943:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787832937.791986:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c357b6903c0 x1874678300896384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832937.792001:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300896384:0@lo:400:kworker.0 00000040:00080000:2.0:1787832937.792831:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787832937.793821:0:15115:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787832937.793852:0:15115:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787832937.793874:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d96 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.793897:0:15115:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87a00/0x72bd9178b14b7d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7d96 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787832937.793945:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787832937.793947:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787832937.793949:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832937.793950:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832937.793951:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832937.793953:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832937.793954:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832937.793956:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832937.793958:0:15115:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832937.793961:0:15115:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787832937.793964:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787832937.793965:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787832937.793966:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787832937.793967:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787832937.793968:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787832937.793970:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787832937.793971:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787832937.793972:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787832937.793973:0:15115:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787832937.794000:0:15115:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787832937.794020:0:15115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787832937.794098:0:15115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832937.794139:0:15115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.794165:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896512 00000100:00100000:0.0:1787832937.794170:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896512 00000100:00100000:0.0:1787832937.794209:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787832937.794218:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:15115:x1874678300896512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787832937.794243:0:14427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787832937.794257:0:14427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787832937.826317:0:14427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787832937.826365:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787832937.828304:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787832937.828314:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787832937.828338:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.828360:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.828370:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.828420:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.828435:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 16 pid: 14428 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832937.828451:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300896640:0@lo:104: 00000100:00100000:3.0:1787832937.828544:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.828599:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603db480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832937.828856:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896640 00000100:00100000:0.0:1787832937.828865:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896640 00000100:00100000:0.0:1787832937.828917:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832937.828927:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300896640:12345-0@lo:104: 00010000:00010000:0.0:1787832937.828941:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832937.829016:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787832937.829022:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300896640:12345-0@lo:104: Request processed in 97us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832937.829029:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787832937.829116:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300896640:0@lo:104: 00010000:00010000:1.0:1787832937.829139:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829803:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832937.829811:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829820:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1787832937.829824:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829833:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787832937.829839:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832937.829845:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787832937.829891:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829898:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787832937.829920:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829928:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad41c00/0x72bd9178b14b7d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d1f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.829947:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832937.829949:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832937.829951:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832937.830005:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787832937.830021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300896768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832937.830065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832937.830203:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896768 00000100:00100000:3.0:1787832937.830219:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896768 00010000:00010000:3.0:1787832937.830242:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 17 pid: 14428 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832937.830276:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832937.830284:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+17:3307:x1874678300896768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832937.830297:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832937.830302:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 17 pid: 14428 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830313:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 17 pid: 14428 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830327:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86c00/0x72bd9178b14b7d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7d18 expref: 17 pid: 14428 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830342:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830351:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787832937.830367:0:14421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002053034s 00010000:00010000:3.0:1787832937.830372:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830379:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830387:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830403:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830408:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832937.830413:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830421:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830434:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832937.830443:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832937.830479:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+16:3307:x1874678300896768:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832937.830486:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787832937.830628:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.830636:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832937.830642:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86200/0x72bd9178b14b7db2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832937.830678:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300896768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787832937.840266:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+15:15115:x1874678300896512:12345-0@lo:253:mount.lustre.0 Request processed in 46036us (46156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832937.840282:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787832937.840405:0:15115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15115:1874678300896512:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787832937.840424:0:15115:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787832937.840427:0:15115:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787832937.840429:0:15115:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787832937.840431:0:15115:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787832937.840432:0:15115:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787832937.840433:0:15115:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787832937.840434:0:15115:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787832937.840436:0:15115:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787832937.840438:0:15115:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787832937.840439:0:15115:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787832937.840459:0:15115:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787832937.847683:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832937.847991:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787832937.848218:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832937.848373:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787832937.848537:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832937.849206:0:15115:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787832937.849980:0:15115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787832937.917161:0:15115:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787832937.917170:0:15115:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787832937.917215:0:15115:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787832937.917283:0:15115:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787832937.917313:0:15115:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787832937.917344:0:15115:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787832938.252005:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787832939.019780:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787832939.019788:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c357b0a7000 from 7 10000000:01000000:1.0:1787832939.019794:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787832939.019854:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832939.019867:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832939.019880:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832939.019909:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300896896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832939.019985:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832939.020051:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35588096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832939.020222:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300896896 00000100:00100000:0.0:1787832939.020232:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300896896 00000100:00100000:0.0:1787832939.020295:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787832939.020307:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+15:14431:x1874678300896896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832939.020321:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832939.020336:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7db9 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832939.020363:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832939.020375:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 16 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832939.020386:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:0.0:1787832939.020436:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:14431:x1874678300896896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832939.020461:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787832939.020819:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300896896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832939.020837:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832939.020846:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832939.020903:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300897024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787832939.020937:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832939.020968:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354308ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787832939.021079:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897024 00000100:00100000:0.0:1787832939.021084:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897024 00000100:00100000:0.0:1787832939.021116:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787832939.021124:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:14431:x1874678300897024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787832939.021137:0:14427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787832939.021153:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787832939.021157:0:14427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787832939.021252:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:14431:x1874678300897024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832939.021259:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787832939.021371:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300897024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787832939.021423:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787832939.021436:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832939.021444:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832939.276996:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832940.300419:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832941.324078:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832942.347891:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787832942.859973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787832942.859989:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787832942.859991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787832942.859994:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787832942.860079:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832942.860229:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832942.860236:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300897152:0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832942.860301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300897408:0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832942.860371:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897280 00000100:00100000:3.0:1787832942.860379:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897280 00000100:00100000:3.0:1787832942.860435:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897408 00000100:00100000:3.0:1787832942.860438:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897408 00000100:00100000:3.0:1787832942.860467:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832942.860476:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860531:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300897280:12345-0@lo:400:kworker.0 Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832942.860539:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832942.860557:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832942.860563:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300897408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860594:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300897408:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832942.860601:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832942.860627:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897152 00000100:00100000:3.0:1787832942.860638:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897152 00000100:00100000:3.0:1787832942.860667:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787832942.860673:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:3306:x1874678300897152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.860729:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:3306:x1874678300897152:12345-0@lo:400:kworker.0 Request processed in 56us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832942.860735:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787832942.860779:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787832942.861035:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6f840 x1874678300897408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832942.861048:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300897408:0@lo:400:kworker.0 00000100:00100000:3.0:1787832942.861076:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300897152:0@lo:400:kworker.0 00010000:00080000:3.0:1787832942.861086:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6e1c0 x1874678300897280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832942.861093:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300897280:0@lo:400:kworker.0 00010000:00010000:2.0:1787832943.372507:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787832944.241369:0:15481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787832944.398106:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832945.419998:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832946.443873:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832947.470974:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787832947.852306:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787832947.988084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787832947.988091:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787832947.988094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787832947.988097:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787832947.991615:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300897536:0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.991735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832947.991820:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300897792:0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.991848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832947.991867:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832947.991873:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300897664:0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.991893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832947.991919:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897536 00000100:00100000:3.0:1787832947.991939:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897536 00000100:00100000:3.0:1787832947.991990:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787832947.992000:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:3308:x1874678300897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.992058:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:3308:x1874678300897536:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832947.992064:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787832947.992098:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897792 00000100:00100000:3.0:1787832947.992102:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897792 00000100:00100000:3.0:1787832947.992132:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897664 00000100:00100000:3.0:1787832947.992150:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897664 00000100:00100000:3.0:1787832947.992168:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832947.992174:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300897792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.992209:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300897792:12345-0@lo:400:kworker.0 Request processed in 36us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832947.992216:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832947.992228:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832947.992234:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300897664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832947.992259:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300897664:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832947.992265:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787832947.992308:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300897536:0@lo:400:kworker.0 00000100:00080000:3.0:1787832947.992345:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787832947.992371:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c34430ef840 x1874678300897664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832947.992383:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300897664:0@lo:400:kworker.0 00010000:00080000:3.0:1787832947.993168:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c34430eed00 x1874678300897792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832947.993193:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300897792:0@lo:400:kworker.0 00010000:00010000:2.0:1787832948.494889:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832949.526782:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832950.034044:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832935/real 1787832935] req@ffff8c35465dda40 x1874678300893696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832950 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832950.034087:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c35465dda40 x1874678300893696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832950 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832950.034098:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787832935/real 1787832935] req@ffff8c35465de1c0 x1874678300893824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832950 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832950.034111:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c35465de1c0 x1874678300893824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787832950 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787832950.034132:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3550787800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787832950.034230:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787832950.034235:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300893696:0@lo:8:kworker.0 00000100:00080000:2.0:1787832950.034241:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787832950.041870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787832950.041878:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787832950.041882:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c3550787800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787832950.041891:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1787832950.041898:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787832950.041906:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3550787800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:1.0:1787832950.042027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832950.042055:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300897920:0@lo:400:kworker.0 00000100:00100000:1.0:1787832950.042126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832950.042249:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3565b6d680 x1874678300898048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787832950.042263:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787832950.042266:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787832950.042268:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787832950.042272:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1787832950.042275:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787832950.042279:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c357bb26000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832950.042290:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3565b6f0c0 x1874678300898176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787832950.042351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300898304:0@lo:400:kworker.0 00000100:00100000:1.0:1787832950.042388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832950.042454:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300897920 00000100:00100000:3.0:1787832950.042461:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300897920 00000100:00100000:3.0:1787832950.042514:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787832950.042525:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:3308:x1874678300897920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787832950.042730:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787832950.042735:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300893824:0@lo:8:kworker.0 00000100:00100000:2.0:1787832950.042761:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300898048:0@lo:8:kworker.0 00000100:00100000:2.0:1787832950.042795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832950.042814:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300898176:0@lo:8:kworker.0 00000100:00100000:2.0:1787832950.042835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832950.042867:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898048 00000100:00100000:2.0:1787832950.042870:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898048 00000100:00100000:2.0:1787832950.042885:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898176 00000100:00100000:2.0:1787832950.042887:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898176 00000100:00100000:2.0:1787832950.042895:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832950.042900:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874678300898048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787832950.043006:0:15117:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1787832950.043032:0:15117:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b7dc7 00002000:00100000:2.0:1787832950.043045:0:15117:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c3566264000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787832950.043049:0:15117:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787832950.043052:0:15117:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787832950.043885:0:15117:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787832950.043923:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8c3566260000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787832950.043975:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874678300898048:12345-0@lo:8:kworker.0 Request processed in 1073us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832950.043984:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787832950.044006:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832950.044022:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874678300898176:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787832950.044035:0:15117:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787832950.044059:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874678300898176:12345-0@lo:8:kworker.0 Request processed in 36us (1223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787832950.044065:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787832950.044149:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6d680 x1874678300898048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787832970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832950.044161:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787832950.044170:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787832950.044178:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787832950.044183:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787832950.044185:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c3550787800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787832950.044210:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787832950.044214:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300898048:0@lo:8:kworker.0 00000100:00080000:0.0:1787832950.044225:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787832950.044228:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787832950.044231:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300898176:0@lo:8:kworker.0 00000004:00080000:2.0:1787832950.044852:0:14457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787832950.044872:0:14457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1874678300898688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787832950.044918:0:14457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832950.044944:0:14457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3543756840 going to sleep for 11 seconds 00000100:00100000:0.0:1787832950.045005:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898688 00000100:00100000:0.0:1787832950.045011:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898688 00000100:00100000:0.0:1787832950.045059:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832950.045076:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14457:x1874678300898688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787832950.047539:0:15119:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787832950.047550:0:15119:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787832950.047555:0:15119:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:2.0:1787832950.049048:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832950.049605:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300898560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832950.049726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832950.049785:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832950.049794:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300898432:0@lo:400:kworker.0 00000100:00100000:2.0:1787832950.049831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832950.049876:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898304 00000100:00100000:2.0:1787832950.049885:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898304 00000100:00100000:2.0:1787832950.049944:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898432 00000100:00100000:2.0:1787832950.049948:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898432 00000100:00100000:2.0:1787832950.049976:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787832950.049986:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300898304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832950.050043:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b692940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300898304:12345-0@lo:400:kworker.0 Request processed in 57us (7653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832950.050050:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787832950.050069:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787832950.050076:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300898432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832950.050124:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874678300898432:12345-0@lo:400:kworker.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832950.050131:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787832950.050146:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787832950.050180:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6da40 x1874678300898432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832950.050195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874678300898432:0@lo:400:kworker.0 00000100:00100000:3.0:1787832950.058234:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:3308:x1874678300897920:12345-0@lo:400:kworker.0 Request processed in 15697us (16094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832950.058267:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787832950.058368:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898560 00000100:00100000:3.0:1787832950.058379:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898560 00000100:00100000:3.0:1787832950.058433:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787832950.058441:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300898560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832950.058484:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832950.058561:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300898560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (8835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832950.058568:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787832950.058627:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c34430ef0c0 x1874678300898560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787832950.058647:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300898560:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1787832950.063257:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.063270:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.063289:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.063304:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.063311:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.063331:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.063342:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.063351:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832950.063615:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ea647735-d55a-4124-bae8-f7db9715e04e:3308:1874678300897920:0@lo:400:kworker.0 00010000:00080000:1.0:1787832950.063654:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6e580 x1874678300898304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832950.063668:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300898304:0@lo:400:kworker.0 00000004:00080000:1.0:1787832950.063722:0:14456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787832950.064116:0:14456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473092412913ns, next at 0ns, rc = 0 00010000:00010000:0.0:1787832950.064311:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.064323:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.064330:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.064350:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.064366:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.064377:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.064398:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.064406:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a275c9bd/0x72bd9178b14b7dce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.064426:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.064427:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.064429:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.065035:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.065043:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065055:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.065059:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.065066:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065078:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065094:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065102:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065119:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.065131:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.065136:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065144:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.065147:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065155:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065168:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065176:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029615be8/0x72bd9178b14b7dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.065189:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.065197:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.065198:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.069011:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.069027:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069055:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.069060:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.069068:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069083:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069094:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069100:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069168:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787832950.069830:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.069838:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069847:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.069850:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.069855:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069873:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069881:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.069889:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077090:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832950.077107:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077122:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.077127:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077138:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077166:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077190:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029011e2c/0x72bd9178b14b7ddc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077311:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832950.077315:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077323:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.077326:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077334:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077344:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.077352:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.077354:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.077356:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.080576:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787832950.080593:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24363f3/0x72bd9178b14b7de3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787832950.081275:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.081284:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081313:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.081317:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.081325:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081341:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081364:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081371:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081392:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.081403:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.081409:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081417:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.081423:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081432:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081452:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081460:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619a14b9/0x72bd9178b14b7dea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081475:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.081482:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.081484:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.081904:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.081910:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081919:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.081923:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.081927:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081937:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081945:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081952:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081968:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.081975:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.081979:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.081986:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.081989:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082008:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082019:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082026:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b7df1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082041:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.082042:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.082044:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.082450:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.082456:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082465:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.082468:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.082473:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082482:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082491:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082505:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082519:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.082527:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.082531:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082537:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.082541:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082548:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082559:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082565:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057ab9916/0x72bd9178b14b7df8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.082578:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.082580:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.082581:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.083001:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.083016:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083024:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.083028:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.083032:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083042:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083050:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083057:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083071:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.083079:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.083082:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083089:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.083092:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083100:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083117:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083125:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013e772f5/0x72bd9178b14b7dff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083137:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.083139:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.083141:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.083587:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.083593:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083602:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.083606:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.083610:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083619:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083627:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083634:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083659:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.083668:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.083671:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083678:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.083681:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083689:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083737:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083745:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f01ffc38/0x72bd9178b14b7e06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.083760:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.083761:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.083763:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832950.084185:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832950.084191:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084200:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1787832950.084209:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832950.084214:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084224:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084232:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084240:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084256:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.084265:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.084269:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084276:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.084279:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.084287:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.084729:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787832950.086389:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.086401:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086418:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.086423:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.086430:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086444:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086455:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086462:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086483:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832950.086496:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787832950.086926:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.086933:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086953:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.086956:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.086961:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086970:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086979:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086986:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.086994:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787832950.087377:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.087383:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087391:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.087394:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.087398:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087408:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087426:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087433:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087441:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787832950.087853:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.087859:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087867:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.087870:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.087874:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087883:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087892:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087899:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.087917:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787832950.088288:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.088307:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088315:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.088317:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.088322:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088330:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088337:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088344:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088352:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787832950.088769:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.088775:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088784:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.088792:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.088797:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088806:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088813:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088821:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.088829:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787832950.089202:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832950.089207:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.089217:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1787832950.089220:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832950.089224:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.089233:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.089240:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.089253:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.089262:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1787832950.091941:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.091966:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f893d1df/0x72bd9178b14b7e0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.091992:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787832950.091997:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092005:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092009:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092019:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092029:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092036:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e009706/0x72bd9178b14b7e1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092050:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787832950.092054:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092060:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092070:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092080:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092090:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092096:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d47e245/0x72bd9178b14b7e22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092107:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787832950.092110:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092116:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092119:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092125:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092132:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092138:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac6fa49/0x72bd9178b14b7e29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092155:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787832950.092158:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092164:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092167:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092175:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092185:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092192:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1727f4f/0x72bd9178b14b7e30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092203:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832950.092207:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092214:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092217:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092237:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092247:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092253:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000980b9027/0x72bd9178b14b7e37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092265:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.092268:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092273:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.092276:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092283:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092302:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092309:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069111456/0x72bd9178b14b7e3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.092332:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.092334:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.092336:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.099275:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.099301:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.099322:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.099336:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.099345:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.099362:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.099373:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.099381:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.099410:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832950.099622:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832950.099630:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099640:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.099645:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099655:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099675:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099683:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055ffad39/0x72bd9178b14b7e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099720:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099722:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099724:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099792:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099799:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099819:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832950.099823:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099830:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099841:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099847:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e212bd/0x72bd9178b14b7e14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832950.099862:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099864:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099865:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099870:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832950.099871:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.101464:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.101475:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.101633:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.101639:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.101646:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.101659:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.101670:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.101684:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.101723:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787832950.102126:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.102132:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102142:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.102145:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.102150:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102159:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102167:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102174:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102191:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787832950.102201:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832950.102207:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102221:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.102226:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102235:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102254:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102262:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945b33a2/0x72bd9178b14b7e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102280:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832950.102283:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102370:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.102375:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102384:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102395:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102408:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df9fff57/0x72bd9178b14b7e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102421:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.102423:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.102425:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.102862:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.102868:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102877:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.102880:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.102885:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102895:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102903:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102911:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.102929:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832950.103357:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832950.103365:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.103374:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832950.103379:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.103387:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.103401:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.103408:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad52974b/0x72bd9178b14b7e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.103425:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.103427:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.103428:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.103759:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.103955:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.103967:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.103977:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.103980:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.103985:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.103994:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104002:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104009:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104063:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787832950.104467:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.104473:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104482:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.104485:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.104498:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104508:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104522:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.104530:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105694:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787832950.105737:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105749:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832950.105754:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105765:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105785:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105793:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001483a214/0x72bd9178b14b7e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105814:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832950.105818:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105825:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832950.105829:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105836:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105858:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.105866:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.105867:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.105870:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.109221:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787832950.109238:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc87680c/0x72bd9178b14b7e68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.109303:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.109941:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.109950:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.109967:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.109971:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.109978:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.109992:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110001:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110020:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110035:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787832950.110424:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.110429:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110438:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.110442:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.110446:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110455:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110463:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110471:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110486:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787832950.110860:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.110866:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110880:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.110883:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.110887:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110896:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110905:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110912:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110927:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787832950.110941:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787832950.110947:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110954:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.110959:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110967:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.110997:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111004:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000903e1b83/0x72bd9178b14b7e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111021:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832950.111023:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111029:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.111032:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111037:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111044:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111050:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fa6000/0x72bd9178b14b7e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111060:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832950.111062:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111074:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc87600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832950.111077:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111084:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111092:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111099:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebfe12f4/0x72bd9178b14b7e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.111110:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.111112:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.111113:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832950.111122:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.111658:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787832950.112129:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787832950.112135:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.112148:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:3.0:1787832950.112152:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832950.112158:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.112182:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.112190:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.112197:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832950.112219:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787832950.112407:0:15119:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1787832950.112536:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14457:x1874678300898688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67457us (67623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832950.112550:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832950.112667:0:14457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1874678300898688:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787832950.112686:0:14457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787832950.112774:0:14457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1874678300898816:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787832950.112811:0:14457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832950.112853:0:14457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35431eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832950.112867:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898816 00000100:00100000:3.0:1787832950.112874:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898816 00000100:00100000:3.0:1787832950.112915:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832950.112925:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14457:x1874678300898816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787832950.112962:0:15117:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1787832950.113348:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832950.113357:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.113367:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832950.113372:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.113381:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.113400:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.113408:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c640d72f/0x72bd9178b14b7e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832950.113429:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.113431:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832950.113439:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832950.120436:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14457:x1874678300898816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7505us (7617us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787832950.120450:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832950.121105:0:14457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1874678300898816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787832950.121127:0:14457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:3.0:1787832950.136085:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787832950.540267:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832951.566675:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787832951.779740:0:15831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787832951.779747:0:15831:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787832951.779933:0:15831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3566261800 00000020:01000004:2.0:1787832951.779952:0:15831:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787832951.779967:0:15831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787832951.779981:0:15831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c35738a0000) 00000020:00000080:2.0:1787832951.779997:0:15831:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787832951.838512:0:15831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787832951.839029:0:15831:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787832951.839963:0:15831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787832951.840278:0:15831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787832951.840534:0:15831:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787832951.850933:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 631: rc = 0 00100000:10000000:3.0:1787832951.851034:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 631: rc = 0 00100000:10000000:3.0:1787832951.851128:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 631: rc = 0 00100000:10000000:2.0:1787832951.855157:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 398: rc = 0 00100000:10000000:2.0:1787832951.855421:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 398: rc = 0 00100000:10000000:2.0:1787832951.856008:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 398: rc = 0 00100000:10000000:2.0:1787832951.856252:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 398: rc = 0 00100000:10000000:2.0:1787832951.856518:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 398: rc = 0 00100000:10000000:2.0:1787832951.856777:0:15831:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 398: rc = 0 00000020:00000080:2.0:1787832951.857335:0:15831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787832951.857349:0:15831:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787832951.857359:0:15831:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bd9178b14b7e92 00000020:01000004:2.0:1787832951.857368:0:15831:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787832951.857391:0:15831:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787832951.857395:0:15831:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787832951.857401:0:15831:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787832951.857427:0:15831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787832951.857431:0:15831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787832951.878899:0:15831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787832951.878950:0:15831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.134@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787832951.878954:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787832951.878956:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832951.878958:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832951.878959:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832951.878960:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832951.878961:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832951.878963:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832951.878965:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832951.878966:0:15831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832951.878970:0:15831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787832951.878972:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787832951.878973:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832951.878974:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832951.878975:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832951.878976:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832951.878977:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832951.878978:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832951.878979:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832951.878980:0:15831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787832951.879011:0:15831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787832951.879033:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300898944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787832951.879111:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832951.879177:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35588096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832951.879766:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300898944 00000100:00100000:3.0:1787832951.879774:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300898944 00000100:00100000:3.0:1787832951.879831:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787832951.879842:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15831:x1874678300898944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787832951.879891:0:14429:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787832951.879895:0:14429:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787832951.879898:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787832951.908475:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15831:x1874678300898944:12345-0@lo:253:mount.lustre.0 Request processed in 28614us (29343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832951.908495:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787832951.909023:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300898944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787832951.909043:0:15831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787832951.909046:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787832951.909048:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787832951.909049:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787832951.909051:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787832951.909052:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787832951.909053:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787832951.909054:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787832951.909070:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787832951.909072:0:15831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787832951.909093:0:15831:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3566261800 from lustre-OST0001 10000000:01000000:2.0:1787832951.909121:0:15831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787832951.909124:0:15831:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787832951.909133:0:15831:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c3442963370 local copy 00010000:00010000:2.0:1787832951.909145:0:15831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832951.910155:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832951.910216:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832951.910257:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3558809900 going to sleep for 11 seconds 00000100:00100000:0.0:1787832951.911885:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899072 00000100:00100000:0.0:1787832951.911901:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899072 00000100:00100000:0.0:1787832951.911971:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787832951.911981:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:15831:x1874678300899072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832951.912359:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+16:15831:x1874678300899072:12345-0@lo:501:mount.lustre.0 Request processed in 378us (2142us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787832951.912374:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787832951.912512:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787832951.912539:0:15831:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787832951.912760:0:15831:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787832951.912770:0:15831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.912781:0:15831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87200/0x72bd9178b14b7c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7c46 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832951.912810:0:15831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3566261800 10000000:01000000:1.0:1787832951.912816:0:15831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787832951.912821:0:15831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787832951.912823:0:15831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787832951.912827:0:15831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787832951.912831:0:15831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787832951.912864:0:15831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.912872:0:15831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.912883:0:15831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832951.912905:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787832951.912951:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832951.912977:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787832951.913226:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899200 00000100:00100000:0.0:1787832951.913231:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899200 00000100:00100000:0.0:1787832951.913281:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787832951.913290:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:15831:x1874678300899200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832951.913300:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832951.913313:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b7ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7e99 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832951.913336:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b7ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7e99 expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832951.913348:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c35429d5800/0x72bd9178b14b7ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7e99 expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832951.913357:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c35429d5800, rc 0) 00000100:00100000:0.0:1787832951.913391:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899200:12345-0@lo:101:mount.lustre.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832951.913397:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787832951.913638:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832951.913654:0:15831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ea0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.913664:0:15831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7ea0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787832951.915526:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787832951.917225:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787832951.917489:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787832951.917527:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787832951.917553:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787832951.917589:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787832951.917627:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787832951.917651:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787832951.917765:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787832951.917773:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787832951.917863:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832951.917938:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832951.917977:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832951.918401:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899328 00000100:00100000:0.0:1787832951.918411:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899328 00000100:00100000:0.0:1787832951.918474:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787832951.918484:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832951.918960:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899328:12345-0@lo:501:mount.lustre.0 Request processed in 477us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832951.918970:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787832951.920553:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832951.920636:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787832951.920940:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832951.920976:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787832951.922069:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899456 00000100:00100000:0.0:1787832951.922092:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899456 00000100:00100000:0.0:1787832951.922158:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787832951.922169:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832951.922985:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899456:12345-0@lo:503:mount.lustre.0 Request processed in 817us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832951.922995:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787832951.923116:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787832951.924224:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787832951.924346:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832951.924406:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832951.924617:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787832951.929993:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899584 00000100:00100000:3.0:1787832951.930008:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899584 00000100:00100000:3.0:1787832951.930082:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787832951.930093:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787832951.930488:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899584:12345-0@lo:502:mount.lustre.0 Request processed in 395us (6080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832951.930497:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787832951.935928:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787832951.936318:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787832951.936385:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787832951.936415:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787832951.936933:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787832951.936977:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787832951.937013:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787832951.937064:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787832951.937098:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787832951.937145:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787832951.937196:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832951.937291:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832951.937341:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832951.937542:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899712 00000100:00100000:1.0:1787832951.937550:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899712 00000100:00100000:1.0:1787832951.937995:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787832951.938007:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832951.938221:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899712:12345-0@lo:502:mount.lustre.0 Request processed in 216us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832951.938230:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787832951.938346:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787832951.938435:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787832951.938447:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787832951.941754:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787832951.941768:0:15832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787832951.941776:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.941778:0:15832:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787832951.941784:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787832951.941802:0:15832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c35738a4d28) 00000020:00000080:2.0:1787832951.941825:0:15832:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787832951.941832:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787832951.941901:0:15832:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3566261800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787832951.941909:0:15832:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787832951.941915:0:15832:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72bd9178b14b7eae 00010000:00010000:3.0:1787832951.958338:0:15832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787832951.958877:0:15832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787832951.972549:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787832951.982643:0:15832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787832951.982656:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832951.982662:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.982664:0:15832:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787832951.982667:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832951.987131:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.987139:0:15832:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787832951.987151:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787832951.987163:0:15832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787832951.987168:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832951.987171:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.987172:0:15832:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787832951.987175:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787832951.987178:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.987179:0:15832:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787832951.987183:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787832951.987275:0:15832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787832951.987279:0:15832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787832951.987281:0:15832:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787832951.987284:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787832951.987497:0:15831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787832951.987537:0:15831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787832951.987561:0:15831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ea0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.987573:0:15831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad41e00/0x72bd9178b14b7e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ea0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832951.987582:0:15831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3566261800 from 1 10000000:01000000:1.0:1787832951.987585:0:15831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787832951.987626:0:15831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.987634:0:15831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.987647:0:15831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832951.987680:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787832951.987792:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832951.987837:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899840 00000100:00100000:1.0:1787832951.987846:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899840 00000100:00100000:1.0:1787832951.988093:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787832951.988106:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+17:15831:x1874678300899840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832951.988121:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832951.988138:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7eb5 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.988166:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.988177:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.988187:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832951.988226:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542d3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300899840:12345-0@lo:101:mount.lustre.0 Request processed in 123us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832951.988233:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787832951.988293:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787832951.988318:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787832951.988332:0:15831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832951.988342:0:15831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787832951.992636:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787832951.997136:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787832951.997448:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787832951.997495:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787832951.997560:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787832951.997570:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787832951.997674:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832951.999086:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.002943:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787832952.003875:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300899968 00000100:00100000:2.0:1787832952.004009:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300899968 00000100:00100000:2.0:1787832952.004116:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787832952.004128:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300899968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787832952.004542:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542d3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300899968:12345-0@lo:501:mount.lustre.0 Request processed in 416us (5458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.004550:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787832952.008894:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b693c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300899968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832952.008982:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787832952.009062:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832952.009118:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787832952.009233:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900096 00000100:00100000:3.0:1787832952.009241:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900096 00000100:00100000:3.0:1787832952.009305:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787832952.009316:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787832952.009650:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542d3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900096:12345-0@lo:503:mount.lustre.0 Request processed in 335us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832952.009658:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787832952.009845:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787832952.011353:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787832952.011451:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832952.011520:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832952.011601:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832952.011679:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900224 00000100:00100000:2.0:1787832952.011686:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900224 00000100:00100000:2.0:1787832952.011812:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787832952.011821:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787832952.012064:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900224:12345-0@lo:502:mount.lustre.0 Request processed in 243us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.012072:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787832952.012366:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787832952.012590:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787832952.012643:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787832952.012745:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787832952.012782:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787832952.012811:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787832952.012854:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787832952.013650:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787832952.013872:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787832952.013930:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787832952.014006:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832952.014048:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832952.015688:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900352 00000100:00100000:2.0:1787832952.015728:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900352 00000100:00100000:2.0:1787832952.015789:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787832952.015798:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787832952.016074:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900352:12345-0@lo:502:mount.lustre.0 Request processed in 278us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.016082:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787832952.016280:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787832952.016439:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787832952.016455:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787832952.023270:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832952.023283:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023285:0:15836:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787832952.023293:0:15836:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3566261800 00000020:00000080:0.0:1787832952.023295:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832952.023303:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832952.023305:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023306:0:15836:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787832952.023309:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832952.023311:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023313:0:15836:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787832952.023316:0:15836:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3566261800 00000020:00000080:0.0:1787832952.023318:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832952.023396:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832952.023400:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023402:0:15836:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787832952.023404:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787832952.023407:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023409:0:15836:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787832952.023412:0:15836:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3566261800 00000020:00000080:0.0:1787832952.023415:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787832952.023455:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787832952.023459:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787832952.023460:0:15836:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787832952.023464:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787832952.023602:0:15831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787832952.023630:0:15831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787832952.023659:0:15831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.023671:0:15831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832952.023740:0:15831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787832952.023743:0:15831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3566261800 10000000:01000000:1.0:1787832952.023746:0:15831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3566261800 10000000:01000000:1.0:1787832952.023751:0:15831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787832952.023757:0:15831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3566261800 from 1 10000000:01000000:1.0:1787832952.023760:0:15831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787832952.023802:0:15831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.023822:0:15831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.023836:0:15831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832952.023864:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787832952.023947:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.023990:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787832952.024314:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900480 00000100:00100000:2.0:1787832952.024324:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900480 00000100:00100000:2.0:1787832952.024379:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787832952.024388:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300900480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787832952.024402:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832952.024415:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356610a400/0x72bd9178b14b7eca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7ec3 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.024442:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610a400/0x72bd9178b14b7eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7ec3 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.024454:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356610a400/0x72bd9178b14b7eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7ec3 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.024463:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a400, rc 0) 00000100:00100000:2.0:1787832952.024518:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900480:12345-0@lo:101:mount.lustre.0 Request processed in 131us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.024526:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787832952.025001:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787832952.025019:0:15831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7eca expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832952.025028:0:15831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7eca expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787832952.025624:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787832952.026062:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787832952.026337:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787832952.026379:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787832952.026410:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787832952.026462:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787832952.026496:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787832952.026542:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787832952.026576:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787832952.026624:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787832952.026670:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787832952.026727:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787832952.026764:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787832952.026819:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787832952.026854:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787832952.026887:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787832952.026929:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787832952.026962:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787832952.026995:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787832952.027038:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787832952.027072:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787832952.027105:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787832952.027153:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787832952.027188:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787832952.027217:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787832952.027293:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787832952.027333:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787832952.027363:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787832952.027407:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787832952.027443:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787832952.027477:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787832952.027528:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787832952.027565:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787832952.027601:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787832952.027634:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787832952.027699:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787832952.027766:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787832952.027817:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787832952.027852:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787832952.027932:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787832952.027941:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787832952.028046:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787832952.028113:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832952.028171:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900608 00000100:00100000:0.0:1787832952.028177:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900608 00000100:00100000:0.0:1787832952.028234:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787832952.028243:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832952.030783:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354811c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787832952.039817:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900608:12345-0@lo:501:mount.lustre.0 Request processed in 11567us (11695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832952.039831:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787832952.042382:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787832952.042452:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787832952.042522:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.042570:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900736 00000100:00100000:1.0:1787832952.042577:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900736 00000100:00100000:1.0:1787832952.042626:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787832952.042634:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787832952.042970:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900736:12345-0@lo:503:mount.lustre.0 Request processed in 335us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.042978:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787832952.043039:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832952.043054:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787832952.043578:0:15831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787832952.043645:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832952.043692:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.043754:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832952.047888:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900864 00000100:00100000:1.0:1787832952.047904:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900864 00000100:00100000:1.0:1787832952.047969:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787832952.047980:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832952.048370:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900864:12345-0@lo:502:mount.lustre.0 Request processed in 391us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.048378:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787832952.048452:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787832952.048748:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787832952.048797:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787832952.048825:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787832952.048862:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787832952.048891:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787832952.048930:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787832952.048976:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787832952.049004:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787832952.049043:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787832952.049074:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787832952.049101:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787832952.049141:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787832952.049173:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787832952.049204:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787832952.049271:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787832952.049309:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787832952.049339:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787832952.049376:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787832952.049405:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787832952.049437:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787832952.049475:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787832952.049516:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787832952.049554:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787832952.049600:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787832952.049628:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787832952.049653:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787832952.049693:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787832952.049749:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787832952.049779:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787832952.049822:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787832952.049854:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787832952.049882:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787832952.049913:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787832952.049957:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787832952.049990:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787832952.050029:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787832952.050058:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787832952.050091:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787832952.050152:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787832952.050185:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787832952.050236:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832952.050322:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.050372:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300900992 00000100:00100000:1.0:1787832952.050378:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300900992 00000100:00100000:1.0:1787832952.050417:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832952.050426:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787832952.050620:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300900992:12345-0@lo:502:mount.lustre.0 Request processed in 194us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.050628:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787832952.050680:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787832952.050721:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b690000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300900992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787832952.050793:0:15831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787832952.050802:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787832952.065035:0:15841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787832952.065054:0:15841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c356afacd28) 00000020:00000080:3.0:1787832952.065080:0:15841:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787832952.065177:0:15841:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3566261800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787832952.065181:0:15841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3566261800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787832952.065184:0:15841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3566261800 3 00010000:00080000:3.0:1787832952.065214:0:15841:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c344221f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.134@tcp at head 00010000:00010000:3.0:1787832952.066684:0:15841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787832952.066900:0:15841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787832952.066931:0:15841:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787832952.066942:0:15841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72bd9178b14b7ed8 00000100:00080000:3.0:1787832952.066953:0:15841:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787832952.066959:0:15841:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c344221f800 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:3.0:1787832952.067002:0:15841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3565b6ed00 x1874678300901120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787832952.067033:0:15841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787832952.068692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787832952.068698:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787832952.068719:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787832952.068727:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1787832952.068733:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787832952.068739:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c357bb26000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832952.068766:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c34430ef840 x1874678300901376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787832952.068817:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300901632:0@lo:400:kworker.0 00000100:00100000:2.0:1787832952.068882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832952.068935:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901632 00000100:00100000:2.0:1787832952.068941:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901632 00000100:00100000:2.0:1787832952.068994:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787832952.069002:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300901632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832952.069047:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874678300901632:12345-0@lo:400:kworker.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.069054:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787832952.069071:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787832952.069101:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c34430ed2c0 x1874678300901632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832952.069116:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874678300901632:0@lo:400:kworker.0 00000100:00100000:1.0:1787832952.070671:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300901504:0@lo:400:kworker.0 00000100:00100000:1.0:1787832952.070740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.070776:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832952.070783:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300901248:0@lo:400:kworker.0 00000100:00100000:1.0:1787832952.070809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.070839:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300901120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787832952.070865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.070892:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300901376:0@lo:8:kworker.0 00000100:00100000:1.0:1787832952.070910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.070941:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901504 00000100:00100000:1.0:1787832952.070946:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901504 00000100:00100000:1.0:1787832952.070984:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901120 00000100:00100000:1.0:1787832952.070987:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901120 00000100:00100000:1.0:1787832952.071003:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787832952.071012:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300901504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832952.071058:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874678300901504:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.071065:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787832952.071081:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832952.071086:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1874678300901120:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787832952.071110:0:14435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1787832952.071145:0:14435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72bd9178b14b7edf 00000004:00100000:1.0:1787832952.071161:0:14435:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787832952.071207:0:14435:0:(import.c:65:import_set_state_nolock()) ffff8c356616e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832952.071254:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874678300901120:12345-0@lo:38:llog_process_th.0 Request processed in 166us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.071273:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832952.071297:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901248 00000100:00100000:1.0:1787832952.071301:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901248 00000100:00100000:1.0:1787832952.071331:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901376 00000100:00100000:1.0:1787832952.071334:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901376 00000100:00100000:1.0:1787832952.071345:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832952.071351:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300901248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832952.071383:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b693c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1874678300901248:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.071389:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832952.071401:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832952.071405:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874678300901376:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787832952.071436:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874678300901376:12345-0@lo:8:kworker.0 Request processed in 30us (524us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787832952.071442:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832952.071485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300901248:0@lo:400:kworker.0 00010000:00080000:1.0:1787832952.071499:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c34430ec780 x1874678300901504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832952.071508:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874678300901504:0@lo:400:kworker.0 00010000:00080000:1.0:1787832952.071538:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3565b6ed00 x1874678300901120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787832962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787832952.071546:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787832952.071553:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787832952.071561:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787832952.071573:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787832952.071576:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c344221f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787832952.071581:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874678300901120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787832952.071594:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787832952.071598:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787832952.071602:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787832952.071605:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300901376:0@lo:8:kworker.0 00000100:00080000:1.0:1787832952.071624:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787832952.074117:0:15841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787832952.079738:0:15831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787832952.079785:0:15831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787832952.079807:0:15831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7eca expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.079819:0:15831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40200/0x72bd9178b14b7ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7eca expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787832952.080882:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787832952.080885:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787832952.080886:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832952.080887:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832952.080889:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832952.080891:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832952.080892:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832952.080894:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832952.080895:0:15831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787832952.080900:0:15831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787832952.080903:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787832952.080904:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787832952.080905:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832952.080906:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832952.080908:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832952.080909:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832952.080917:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832952.080918:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832952.080919:0:15831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787832952.080981:0:15831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787832952.081004:0:15831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300901760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787832952.081094:0:15831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832952.081141:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901760 00000100:00100000:1.0:1787832952.081148:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901760 00000100:00100000:1.0:1787832952.081203:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787832952.081214:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+19:15831:x1874678300901760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787832952.081248:0:14427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787832952.081273:0:14427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787832952.081680:0:15831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354343b0c0 going to sleep for 11 seconds 20000000:01000000:1.0:1787832952.126750:0:14427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787832952.126772:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787832952.126833:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787832952.126838:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787832952.126862:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832952.126882:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832952.126891:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832952.126935:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832952.126950:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 19 pid: 14428 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832952.126967:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300901888:0@lo:104: 00000100:00100000:0.0:1787832952.127045:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832952.127098:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787832952.127755:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300901888 00000100:00100000:1.0:1787832952.127764:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300901888 00000100:00100000:1.0:1787832952.127818:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787832952.127828:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300901888:12345-0@lo:104: 00010000:00010000:1.0:1787832952.127842:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.127907:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832952.127914:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea647735-d55a-4124-bae8-f7db9715e04e+3:14450:x1874678300901888:12345-0@lo:104: Request processed in 88us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832952.127922:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787832952.127944:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832952.127951:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.127976:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41800 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832952.127980:0:14422:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.127989:0:14422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832952.127996:0:14422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832952.128001:0:14422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787832952.128033:0:14422:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.128040:0:14422:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832952.128060:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.128067:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad41800/0x72bd9178b14b7db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7dc0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832952.128084:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832952.128085:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832952.128087:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832952.128107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300902016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832952.128138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832952.128368:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1874678300901888:0@lo:104: 00010000:00010000:2.0:1787832952.128389:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832952.129912:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902016 00000100:00100000:2.0:1787832952.129922:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902016 00010000:00010000:2.0:1787832952.129954:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 20 pid: 14428 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832952.129988:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832952.129998:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b690b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+20:3306:x1874678300902016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832952.130027:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832952.130033:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 20 pid: 14428 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130046:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 20 pid: 14428 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130063:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3540030800/0x72bd9178b14b7dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7db9 expref: 20 pid: 14428 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130080:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130089:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787832952.130106:0:14421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003268525s 00010000:00010000:2.0:1787832952.130111:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130118:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130124:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130131:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130136:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832952.130141:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130157:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130171:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130182:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832952.130240:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b690b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3306:x1874678300902016:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832952.130247:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787832952.130299:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300902016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832952.130327:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130334:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832952.130340:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c35429d4600/0x72bd9178b14b7ee6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832952.180737:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:15831:x1874678300901760:12345-0@lo:253:mount.lustre.0 Request processed in 99491us (99609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832952.180754:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787832952.183380:0:15831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ea647735-d55a-4124-bae8-f7db9715e04e:15831:1874678300901760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787832952.183405:0:15831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787832952.183426:0:15831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787832952.183427:0:15831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787832952.183429:0:15831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787832952.183430:0:15831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787832952.183431:0:15831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787832952.183433:0:15831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787832952.183434:0:15831:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787832952.183437:0:15831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787832952.183438:0:15831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787832952.183525:0:15831:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787832952.187600:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832952.188018:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787832952.188172:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832952.188328:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787832952.188508:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787832952.188845:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787832952.190013:0:15831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787832952.244772:0:15831:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787832952.244782:0:15831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787832952.244816:0:15831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787832952.244877:0:15831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787832952.244891:0:15831:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787832952.244922:0:15831:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787832952.594686:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787832953.232091:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787832953.232114:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:1.0:1787832953.419877:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787832953.419889:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c357b0a7000 from 8 10000000:01000000:1.0:1787832953.419894:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787832953.419950:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832953.419962:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832953.419975:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832953.420004:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300902144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787832953.420082:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832953.420172:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c356af85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787832953.423524:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902144 00000100:00100000:3.0:1787832953.423545:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902144 00000100:00100000:3.0:1787832953.423622:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787832953.423633:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300902144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832953.423653:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832953.423676:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b7ef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b7eed expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832953.423733:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b7ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b7eed expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832953.423746:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87600/0x72bd9178b14b7ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7eed expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832953.423756:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87600, rc 0) 00000100:00100000:3.0:1787832953.423846:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300902144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832953.423854:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787832953.423918:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300902144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832953.423940:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ef4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832953.423950:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b7ef4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832953.424022:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300902272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787832953.424070:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832953.424106:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35589b5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787832953.424192:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902272 00000100:00100000:1.0:1787832953.424205:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902272 00000100:00100000:1.0:1787832953.424245:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787832953.424253:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300902272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787832953.424268:0:14429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787832953.424285:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787832953.424288:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787832953.424374:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300902272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832953.424382:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787832953.424546:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300902272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787832953.424612:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787832953.424620:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ef4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832953.424631:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c357ad40600/0x72bd9178b14b7eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b7ef4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832953.612867:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832954.643388:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832955.148033:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787832955.148065:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300902400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832955.148176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832955.148416:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902400 00000100:00100000:3.0:1787832955.148425:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902400 00000100:00100000:3.0:1787832955.148497:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787832955.148508:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300902400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832955.148560:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832955.148610:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300902400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832955.148617:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787832955.149187:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832955.149375:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787832955.149412:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300902400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787832955.662757:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832956.686864:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787832957.071631:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787832957.196087:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787832957.196099:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787832957.196104:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787832957.196122:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c357bb26000 using connection 192.168.201.134@tcp/0@lo 00000100:00100000:2.0:1787832957.196149:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c34430ecb40 x1874678300902784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787832957.196234:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300903040:0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.196326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.196395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787832957.196401:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300902528:0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.196435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.196534:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300903168:0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.196565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.196592:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300902912:0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.196622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.196640:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832957.196855:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300902784:0@lo:8:kworker.0 00000100:00100000:1.0:1787832957.196898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.196935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300902656:0@lo:400:kworker.0 00000100:00100000:1.0:1787832957.196940:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903040 00000100:00100000:1.0:1787832957.196949:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903040 00000100:00100000:1.0:1787832957.197016:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903168 00000100:00100000:1.0:1787832957.197019:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903168 00000100:00100000:1.0:1787832957.197036:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902912 00000100:00100000:1.0:1787832957.197038:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902912 00000100:00100000:1.0:1787832957.197057:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832957.197071:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300903040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.197072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832957.197140:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300903040:12345-0@lo:400:kworker.0 Request processed in 74us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832957.197143:0:14434:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832957.197151:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787832957.197155:0:14434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787832957.197193:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832957.197203:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300903168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.197238:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300903168:12345-0@lo:400:kworker.0 Request processed in 38us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832957.197244:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787832957.197259:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832957.197265:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c34430ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300902912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.197296:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c34430ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300902912:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832957.197303:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787832957.200564:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902528 00000100:00100000:2.0:1787832957.200584:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902528 00000100:00100000:3.0:1787832957.201077:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787832957.201092:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300902528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832957.201228:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300902528:12345-0@lo:400:kworker.0 Request processed in 140us (4791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832957.201237:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1787832957.202142:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c34430ee1c0 x1874678300902912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832957.202163:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300902912:0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.202294:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902784 00000100:00100000:2.0:1787832957.202302:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902784 00000100:00100000:2.0:1787832957.202345:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300902656 00000100:00100000:2.0:1787832957.202348:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300902656 00000100:00100000:2.0:1787832957.202398:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832957.202408:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832957.203638:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300902656:12345-0@lo:400:kworker.0 Request processed in 1222us (6560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832957.204102:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787832957.204154:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787832957.204161:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b691e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874678300902784:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787832957.204213:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1787832957.204256:0:15116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72bd9178b14b7efb 00002000:00100000:2.0:1787832957.204275:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c354387b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787832957.204280:0:15116:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787832957.204284:0:15116:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787832957.205540:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787832957.205584:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8c3543879000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832957.205655:0:15119:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787832957.205681:0:15119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787832957.206119:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b691e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874678300902784:12345-0@lo:8:kworker.0 Request processed in 1954us (9216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832957.206130:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787832957.206183:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787832957.206191:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832957.206273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300902528:0@lo:400:kworker.0 00010000:00080000:2.0:1787832957.206297:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c34430ec780 x1874678300903168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832957.206311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300903168:0@lo:400:kworker.0 00010000:00080000:2.0:1787832957.206332:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c34430ef840 x1874678300903040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787832957.206342:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300903040:0@lo:400:kworker.0 00010000:00080000:1.0:1787832957.206613:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c34430ecb40 x1874678300902784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787832982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787832957.206642:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787832957.206653:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787832957.206660:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787832957.206664:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8c357bb26000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787832957.206680:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787832957.206686:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874678300902784:0@lo:8:kworker.0 00000100:00100000:2.0:1787832957.207575:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c34430ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300902656:0@lo:400:kworker.0 00000004:00080000:1.0:1787832957.208010:0:14459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787832957.208040:0:14459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1874678300903424:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787832957.208112:0:14459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832957.208148:0:14459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35589b5a80 going to sleep for 11 seconds 00000004:00080000:1.0:1787832957.208185:0:14458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787832957.216348:0:14458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 480243459529ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787832957.216558:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903424 00000100:00100000:1.0:1787832957.216571:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903424 00000100:00100000:1.0:1787832957.216651:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787832957.216667:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14459:x1874678300903424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787832957.227021:0:15117:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787832957.227036:0:15117:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787832957.227043:0:15117:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:0.0:1787832957.233654:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787832957.233714:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300903296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832957.233851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832957.235081:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903296 00000100:00100000:3.0:1787832957.235097:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903296 00000100:00100000:3.0:1787832957.235163:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787832957.235188:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300903296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832957.235244:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832957.235339:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300903296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832957.235358:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787832957.236045:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c357b691a40 x1874678300903296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787832973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832957.236074:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b691a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300903296:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1787832957.240993:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832957.241008:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.241029:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787832957.241034:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832957.241041:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.241102:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.241114:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.241120:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.242727:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.243308:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.243321:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.243338:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.243344:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.243358:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.243386:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.243396:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004eca0a1/0x72bd9178b14b7f02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.243886:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.243891:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.243893:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787832957.246656:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832957.246674:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.246999:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787832957.247007:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832957.247016:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.247035:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.247046:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.247054:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.247088:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787832957.248123:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832957.248133:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248156:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.248160:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787832957.248175:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832957.248177:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.248182:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.248202:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248204:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832957.248211:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.248217:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248233:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.248234:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248261:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248270:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091264e7a/0x72bd9178b14b7f09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.248293:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.248295:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.248296:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.248914:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787832957.250306:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832957.250320:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.250337:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787832957.250342:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832957.250348:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.250364:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.250391:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.250400:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258384:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832957.258410:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258431:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.258436:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258450:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258487:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258495:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e212bd/0x72bd9178b14b7f10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258933:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.258940:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258949:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.258970:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258979:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258991:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.258999:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.259001:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.259003:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.265551:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787832957.265574:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069111456/0x72bd9178b14b7f17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.265648:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.278290:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.278309:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.278331:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.278338:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.278346:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.278366:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.278380:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.278388:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.278425:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787832957.278935:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832957.278946:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787832957.279079:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.279086:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279097:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.279101:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.279106:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279116:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279125:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279133:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279147:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787832957.279610:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.279616:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279627:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.279638:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.279644:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279655:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279664:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279672:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.279687:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787832957.279907:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832957.279915:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.279930:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.279956:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.279977:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067f86c7b/0x72bd9178b14b7f1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280003:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787832957.280008:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280016:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832957.280020:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280043:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280057:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280066:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000601f712d/0x72bd9178b14b7f25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280083:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832957.280086:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280094:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832957.280098:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280106:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280118:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280125:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b385333/0x72bd9178b14b7f2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.280152:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832957.280154:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832957.280157:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.280351:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.280510:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.284007:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.284031:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.284055:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.284062:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.284069:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.284089:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.284103:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.284124:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.284156:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787832957.284401:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787832957.284411:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.284422:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4c00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832957.284426:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.285066:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.285094:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.285103:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b682d97b/0x72bd9178b14b7f33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832957.285138:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832957.285140:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832957.285143:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.286115:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.286128:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.286144:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.286150:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.286156:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.286183:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.286195:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.286204:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.286229:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.286569:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.286579:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.286589:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d4200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.286594:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.286604:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.286624:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.286655:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e97d72b/0x72bd9178b14b7f3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.286692:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.286695:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.286697:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.287571:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.287582:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.287601:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.287605:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.287611:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.287624:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.287633:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.287640:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.287657:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.288131:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.288141:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.288152:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.288157:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.288176:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.288197:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.288205:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057ab9916/0x72bd9178b14b7f41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.288229:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.288232:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.288234:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.289077:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.289086:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.289102:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.289107:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.289113:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.289128:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.289152:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.289160:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.289379:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832957.289626:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832957.289635:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.289656:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832957.289661:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.289678:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.290087:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.290100:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013e772f5/0x72bd9178b14b7f48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.290134:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.290137:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.290141:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.290873:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.290884:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.290898:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.290902:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.290910:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.290925:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.290936:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.290945:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.290987:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787832957.292028:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.292039:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292054:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.292058:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.292064:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292076:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292086:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292094:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292119:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787832957.292137:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832957.292144:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292153:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.292176:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292187:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292205:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292213:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f01ffc38/0x72bd9178b14b7f4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292237:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.292317:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292325:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35429d5400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.292329:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292337:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292350:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292358:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f893d1df/0x72bd9178b14b7f56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.292383:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.292385:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.292387:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.292484:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.293376:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.293388:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293412:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.293416:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.293424:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293437:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293446:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293454:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293478:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.293493:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.293499:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293520:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.293525:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293533:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293548:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293556:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.293573:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.293576:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.293577:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.295071:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.295086:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295104:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.295109:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.295116:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295131:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295150:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295157:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295185:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.295198:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.295204:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295211:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.295215:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295224:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295536:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295546:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.295570:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.295579:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.295581:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.301185:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.301202:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301224:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.301229:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.301238:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301257:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301270:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301278:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301299:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787832957.301776:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.301783:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301792:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.301796:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.301799:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301818:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301827:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301834:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301854:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787832957.301867:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787832957.301874:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301881:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.301885:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301894:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301911:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301919:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000803f122c/0x72bd9178b14b7f6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301950:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.301954:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301961:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413eda00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.301964:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301973:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301984:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.301992:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040695fe6/0x72bd9178b14b7f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302006:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.302009:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.302011:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.302529:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.302536:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302548:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.302557:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.302562:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302573:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302582:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302591:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302608:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.302619:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.302623:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302630:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.302633:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302641:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302653:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302673:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb6e0d8/0x72bd9178b14b7f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.302688:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.302690:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.302691:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.303157:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787832957.304079:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787832957.306807:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787832957.307926:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.307960:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.307967:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.307978:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.307998:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308012:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308021:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308048:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.308071:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.308087:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308097:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ec400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.308102:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308113:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308134:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308142:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f02a78c5/0x72bd9178b14b7f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.308187:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.308189:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.308191:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.311233:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.312585:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.312609:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.312615:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.312624:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.312663:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.312675:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.312684:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.312730:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.312856:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.312867:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.312880:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.312886:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.312898:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.312923:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.312931:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e06ca0/0x72bd9178b14b7f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.312962:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.312964:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.312966:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.313515:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.313523:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.313534:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.313538:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.313543:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.313554:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.313564:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.313584:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.313609:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.313896:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.313903:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.313912:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c35413ed200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.313916:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.313933:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.313947:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.313955:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070eabeca/0x72bd9178b14b7f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.313976:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.313978:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.313981:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.314118:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.314125:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.314134:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.314137:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.314142:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.314152:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.314160:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322136:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322192:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.322219:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.322228:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322257:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.322262:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322275:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322300:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322309:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.322335:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.322337:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.322339:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.325762:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.325785:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325814:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.325819:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.325827:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325844:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325865:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325874:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325905:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.325928:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.325935:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325944:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a01600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.325950:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325960:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325983:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.325991:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000439dc9e4/0x72bd9178b14b7f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326018:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.326028:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.326030:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.326827:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.326836:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326848:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.326852:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.326858:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326869:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326879:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326888:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.326916:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787832957.326932:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832957.326942:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.326952:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a01200 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832957.326956:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.326966:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.326986:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.327009:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd67da9a/0x72bd9178b14b7fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832957.327032:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.327034:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832957.327036:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.331111:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.331129:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.331149:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.331154:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.331161:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.331198:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.331211:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.331219:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333197:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.333235:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.333256:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333273:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00a00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.333278:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333290:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333317:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333326:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a602b1fe/0x72bd9178b14b7faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.333368:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.333371:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.333373:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.334230:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.334240:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334258:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.334263:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.334272:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334289:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334299:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334307:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334326:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.334337:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.334342:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334363:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a01400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.334367:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334376:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334389:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334406:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000071fbc35/0x72bd9178b14b7fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334425:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.334427:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.334428:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.334921:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.334928:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334939:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.334943:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.334948:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334958:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334973:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.334981:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.335007:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787832957.335467:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787832957.335476:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.335488:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00800 already unused, calling callback (ffffffffc160a420) 00010000:00010000:2.0:1787832957.335492:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.335502:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.335517:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.335525:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074159451/0x72bd9178b14b7fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832957.335555:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.335557:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832957.335559:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787832957.340577:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787832957.340600:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340622:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1787832957.340627:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832957.340634:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340651:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340664:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340672:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340899:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787832957.340923:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832957.340931:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340941:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00400 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832957.340946:0:15750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340957:0:15750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340977:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.340986:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deb70483/0x72bd9178b14b7fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832957.341012:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.341014:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832957.341015:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787832957.341823:0:15117:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787832957.341978:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14459:x1874678300903424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 125312us (133858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832957.341989:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787832957.342491:0:14459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6912c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1874678300903424:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787832957.342512:0:14459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787832957.342569:0:14459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2afc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1874678300903552:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787832957.342626:0:14459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832957.343920:0:14459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3544fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787832957.344927:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903552 00000100:00100000:0.0:1787832957.344943:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903552 00000100:00100000:0.0:1787832957.345026:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832957.345037:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14459:x1874678300903552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787832957.345109:0:15119:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787832957.368509:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14459:x1874678300903552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23455us (25864us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787832957.368529:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787832957.373916:0:14459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2afc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1874678300903552:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787832957.373944:0:14459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787832957.711637:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832958.736401:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832959.757962:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832959.862091:0:16188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787832960.268502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832960.268534:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300903680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832960.268629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832960.268977:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903680 00000100:00100000:3.0:1787832960.268987:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903680 00000100:00100000:3.0:1787832960.269065:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787832960.269077:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300903680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832960.269127:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832960.269195:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300903680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832960.269203:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787832960.269332:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832960.269676:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300903680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787832960.780091:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832961.805218:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832962.272525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.272626:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084416 00000100:00100000:0.0:1787832962.272638:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084416 00000100:00100000:0.0:1787832962.272685:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:0.0:1787832962.272694:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355cfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1874678283084416:12345-192.168.201.34@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787832962.272756:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c657dfb7-0284-47b4-ac0a-5336a0328df6@192.168.201.34@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1787832962.272799:0:14427:0:(genops.c:1385:class_connect()) connect: client c657dfb7-0284-47b4-ac0a-5336a0328df6, cookie 0x72bd9178b14b7fc6 00000100:00080000:0.0:1787832962.272961:0:14427:0:(import.c:65:import_set_state_nolock()) ffff8c357c686000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832962.273044:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355cfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+5:2351:x1874678283084416:12345-192.168.201.34@tcp:250:mount.lustre.0 Request processed in 349us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.273054:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 75 00000100:00100000:1.0:1787832962.278038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832962.278136:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084544 00000100:00100000:2.0:1787832962.278149:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084544 00000100:00100000:2.0:1787832962.278215:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:2.0:1787832962.278227:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+5:13754:x1874678283084544:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787832962.278250:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832962.278273:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356610b000/0x72bd9178b14b7fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706af4 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.278306:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610b000/0x72bd9178b14b7fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706af4 expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.278338:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356610b000/0x72bd9178b14b7fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706af4 expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.278348:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610b000, rc 0) 00000100:00100000:2.0:1787832962.278453:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+6:13754:x1874678283084544:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 228us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832962.278461:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 76 00000100:00100000:1.0:1787832962.283576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832962.283674:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084672 00000100:00100000:3.0:1787832962.283686:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084672 00000100:00100000:3.0:1787832962.283787:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:3.0:1787832962.283798:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+6:13754:x1874678283084672:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787832962.284200:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+6:13754:x1874678283084672:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 403us (635us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787832962.284211:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 77 00000100:00100000:1.0:1787832962.292786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.292950:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084800 00000100:00100000:0.0:1787832962.292963:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084800 00000100:00100000:0.0:1787832962.293027:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:0.0:1787832962.293038:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+6:13754:x1874678283084800:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787832962.293057:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832962.293087:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3443a01a00/0x72bd9178b14b7fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706afb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.293143:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3443a01a00/0x72bd9178b14b7fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706afb expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.293157:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3443a01a00/0x72bd9178b14b7fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706afb expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.293168:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a01a00, rc 0) 00000100:00100000:0.0:1787832962.293233:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+7:13754:x1874678283084800:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 197us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.293241:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 78 00000100:00100000:1.0:1787832962.297586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832962.297690:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283084928 00000100:00100000:2.0:1787832962.297726:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283084928 00000100:00100000:2.0:1787832962.297793:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:2.0:1787832962.297803:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+7:13754:x1874678283084928:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787832962.298112:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13754:x1874678283084928:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 308us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832962.298121:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 79 00000100:00100000:1.0:1787832962.300642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832962.300728:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085056 00000100:00100000:3.0:1787832962.300739:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085056 00000100:00100000:3.0:1787832962.300805:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:3.0:1787832962.300817:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13754:x1874678283085056:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787832962.301242:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13754:x1874678283085056:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 425us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832962.301252:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 80 00000100:00100000:1.0:1787832962.305382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.305932:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085184 00000100:00100000:0.0:1787832962.305944:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085184 00000100:00100000:0.0:1787832962.306010:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1787832962.306021:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13772:x1874678283085184:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787832962.306446:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13772:x1874678283085184:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 426us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.306456:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 81 00000100:00100000:0.0:1787832962.317586:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300904192:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.317665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.317748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787832962.317754:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.319239:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904192 00000100:00100000:0.0:1787832962.319249:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904192 00000100:00100000:0.0:1787832962.319364:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787832962.319375:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300904192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319460:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300904192:12345-0@lo:400:kworker.0 Request processed in 86us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.319468:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787832962.319512:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dd680 x1874678300904192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832962.319529:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300904192:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319575:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300903808:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.319635:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.319673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787832962.319679:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300903936:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.319744:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300904448:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.319769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832962.320393:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904320 00000100:00100000:0.0:1787832962.320398:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904320 00000100:00100000:0.0:1787832962.320439:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904448 00000100:00100000:0.0:1787832962.320442:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904448 00000100:00100000:0.0:1787832962.320464:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832962.320472:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300904320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.320510:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300904320:12345-0@lo:400:kworker.0 Request processed in 40us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.320516:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787832962.320541:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832962.320553:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300904448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.320579:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300904448:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.320585:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787832962.320603:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904064 00000100:00100000:0.0:1787832962.320605:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904064 00000100:00100000:0.0:1787832962.320626:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903936 00000100:00100000:0.0:1787832962.320628:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903936 00000100:00100000:0.0:1787832962.320646:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832962.320652:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300904064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.320683:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874678300904064:12345-0@lo:400:kworker.0 Request processed in 31us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.320688:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787832962.320725:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787832962.320732:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300903936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.320760:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300903936:12345-0@lo:400:kworker.0 Request processed in 30us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.320765:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787832962.320974:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787832962.320978:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832962.320981:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832962.321015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300903936:0@lo:400:kworker.0 00010000:00080000:0.0:1787832962.321027:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dc780 x1874678300904448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832962.321036:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300904448:0@lo:400:kworker.0 00010000:00080000:0.0:1787832962.321045:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c35465dd2c0 x1874678300904320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787832978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787832962.321060:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.321103:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.321122:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300903808 00000100:00100000:0.0:1787832962.321125:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300903808 00000100:00100000:1.0:1787832962.321738:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300904576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832962.321794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832962.322829:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904576 00000100:00100000:3.0:1787832962.322838:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904576 00000100:00100000:3.0:1787832962.322891:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832962.322901:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b691a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300904576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832962.322947:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832962.323008:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b691a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300904576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832962.323016:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787832962.323075:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b6921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300904576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787832962.339075:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787832962.339108:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300903808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832962.339392:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300903808:12345-0@lo:400:kworker.0 Request processed in 292us (19778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.339414:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787832962.344406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300903808:0@lo:400:kworker.0 00000100:00100000:0.0:1787832962.365933:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.366331:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085312 00000100:00100000:0.0:1787832962.366343:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085312 00000100:00100000:0.0:1787832962.366447:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:0.0:1787832962.366459:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13772:x1874678283085312:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787832962.366983:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13772:x1874678283085312:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 525us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.366993:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 83 00000100:00100000:1.0:1787832962.390515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.391239:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085440 00000100:00100000:0.0:1787832962.391251:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085440 00000100:00100000:0.0:1787832962.391325:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:0.0:1787832962.391336:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+8:13754:x1874678283085440:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787832962.391354:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832962.391375:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3443a01000/0x72bd9178b14b7fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b25 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.391409:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3443a01000/0x72bd9178b14b7fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b25 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.391421:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3443a01000/0x72bd9178b14b7fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b25 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.391446:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a01000, rc 0) 00000100:00100000:0.0:1787832962.391508:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+9:13754:x1874678283085440:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 174us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.391516:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 84 00000100:00100000:1.0:1787832962.397947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.397982:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085568 00000100:00100000:1.0:1787832962.397992:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085568 00000100:00100000:1.0:1787832962.398046:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:1.0:1787832962.398056:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+9:13754:x1874678283085568:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787832962.398098:0:14427:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787832962.398121:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787832962.398125:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787832962.398129:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787832962.398132:0:14427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787832962.402003:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+9:13754:x1874678283085568:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 3937us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.402018:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 85 00000100:00100000:0.0:1787832962.411725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.411767:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085696 00000100:00100000:0.0:1787832962.411779:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085696 00000100:00100000:0.0:1787832962.411838:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787832962.411853:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+9:13754:x1874678283085696:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787832962.411872:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832962.411893:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b2c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.411927:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.415481:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832962.415505:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a01e00, rc 0) 00000100:00100000:0.0:1787832962.415612:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13754:x1874678283085696:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 3762us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.415623:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 86 00000100:00100000:0.0:1787832962.418490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.418592:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085824 00000100:00100000:1.0:1787832962.418604:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085824 00000100:00100000:1.0:1787832962.418663:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:1.0:1787832962.418674:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13754:x1874678283085824:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787832962.418963:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13754:x1874678283085824:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 290us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.418972:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 87 00000100:00100000:0.0:1787832962.424399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832962.426471:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283085952 00000100:00100000:3.0:1787832962.426487:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283085952 00000100:00100000:3.0:1787832962.426554:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:3.0:1787832962.426564:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13754:x1874678283085952:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787832962.426891:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13754:x1874678283085952:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 327us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832962.426901:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 88 00000100:00100000:1.0:1787832962.435023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.435128:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086080 00000100:00100000:1.0:1787832962.435139:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086080 00000100:00100000:1.0:1787832962.435191:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:1.0:1787832962.435306:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13775:x1874678283086080:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787832962.435676:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13775:x1874678283086080:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 454us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.435686:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 89 00000100:00100000:1.0:1787832962.450250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832962.451643:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086208 00000100:00100000:3.0:1787832962.451657:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086208 00000100:00100000:3.0:1787832962.451768:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 90 00000100:00100000:3.0:1787832962.451780:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13775:x1874678283086208:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787832962.452067:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13775:x1874678283086208:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 288us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832962.452084:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 90 00000001:00080000:0.0:1787832962.462315:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787832962.462349:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787832962.471395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.481473:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086336 00000100:00100000:0.0:1787832962.481494:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086336 00000100:00100000:0.0:1787832962.481575:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:0.0:1787832962.481585:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1874678283086336:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787832962.481620:0:14434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5446e631-f40d-43fa-8297-9fb53157ce22@192.168.201.34@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1787832962.481672:0:14434:0:(genops.c:1385:class_connect()) connect: client 5446e631-f40d-43fa-8297-9fb53157ce22, cookie 0x72bd9178b14b7fe9 00000004:00100000:0.0:1787832962.481738:0:14434:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787832962.481745:0:14434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787832962.531198:0:14434:0:(import.c:65:import_set_state_nolock()) ffff8c357b9ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832962.531306:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:2351:x1874678283086336:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 49719us (59917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.531320:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787832962.534295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832962.534406:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086592 00000100:00100000:0.0:1787832962.534418:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086592 00000100:00100000:0.0:1787832962.534568:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832962.534581:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35591930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+6:13754:x1874678283086592:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787832962.534634:0:14436:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787832962.535010:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35591930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+6:13754:x1874678283086592:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 430us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832962.535020:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00080000:2.0:1787832962.535274:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832962.539426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.539475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832962.539508:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086464 00000100:00100000:2.0:1787832962.539520:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086464 00000100:00100000:2.0:1787832962.539584:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086720 00000100:00100000:2.0:1787832962.539588:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086720 00000100:00100000:2.0:1787832962.539617:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787832962.539628:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787832962.539628:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+7:0:x1874678283086464:12345-192.168.201.34@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787832962.539637:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:13754:x1874678283086720:12345-192.168.201.34@tcp:40:mount.lustre.0 00000004:00000024:2.0:1787832962.539669:0:16067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787832962.539753:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:13754:x1874678283086720:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832962.539762:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:2.0:1787832962.540649:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+6:0:x1874678283086464:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 1019us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832962.540669:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787832962.542834:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832962.543022:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087104 00000100:00100000:2.0:1787832962.543033:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087104 00000100:00100000:2.0:1787832962.543101:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787832962.543112:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:13754:x1874678283087104:12345-192.168.201.34@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787832962.543112:0:14438:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787832962.543121:0:14438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:3.0:1787832962.544218:0:14437:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1020us 00000100:00100000:1.0:1787832962.546237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.546299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832962.546332:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086848 00000100:00100000:1.0:1787832962.546344:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086848 00000100:00100000:1.0:1787832962.546379:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283086976 00000100:00100000:1.0:1787832962.546382:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283086976 00000100:00100000:1.0:1787832962.546402:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787832962.546412:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874678283086848:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787832962.546450:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5446e631-f40d-43fa-8297-9fb53157ce22@192.168.201.34@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1787832962.546488:0:15119:0:(genops.c:1385:class_connect()) connect: client 5446e631-f40d-43fa-8297-9fb53157ce22, cookie 0x72bd9178b14b7ff0 00002000:00100000:1.0:1787832962.546505:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5446e631-f40d-43fa-8297-9fb53157ce22/ffff8c3566168800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787832962.546544:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787832962.547492:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787832962.547552:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8c356616b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832962.547640:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+6:2351:x1874678283086848:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 1226us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.547660:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:1.0:1787832962.547961:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787832962.547969:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874678283086976:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787832962.547999:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5446e631-f40d-43fa-8297-9fb53157ce22@192.168.201.34@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1787832962.548026:0:15119:0:(genops.c:1385:class_connect()) connect: client 5446e631-f40d-43fa-8297-9fb53157ce22, cookie 0x72bd9178b14b7ff7 00002000:00100000:1.0:1787832962.548038:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5446e631-f40d-43fa-8297-9fb53157ce22/ffff8c3566267000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787832962.548049:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787832962.548483:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787832962.548511:0:15119:0:(import.c:65:import_set_state_nolock()) ffff8c3566266800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787832962.549178:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+6:2351:x1874678283086976:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 1203us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.549189:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000004:00200000:1.0:1787832962.561406:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787832962.562260:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:13754:x1874678283087104:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 19139us (19426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832962.565374:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832962.777737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832962.778022:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087232 00000100:00100000:2.0:1787832962.778035:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087232 00000100:00100000:2.0:1787832962.778114:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787832962.778125:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:13796:x1874678283087232:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:2.0:1787832962.778159:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832962.778188:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b7ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b56 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778267:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778294:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778312:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832962.778506:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787832962.778511:0:14434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787832962.778621:0:14434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778652:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ba00/0x72bd9178b14b7ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b56 expref: 8 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778681:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b56 expref: 7 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832962.778698:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:2.0:1787832962.778741:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832962.778746:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610aa00, rc 0) 00000100:00100000:2.0:1787832962.781339:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+7:13796:x1874678283087232:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 3135us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832962.781354:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00010000:00010000:3.0:1787832962.827881:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787832963.373368:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5446e631-f40d-43fa-8297-9fb53157ce22 00010000:00010000:2.0:1787832963.852079:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832964.562379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.562479:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087360 00000100:00100000:1.0:1787832964.562490:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087360 00000100:00100000:1.0:1787832964.562574:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787832964.562587:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+7:13848:x1874678283087360:12345-192.168.201.34@tcp:41:lfs.0 00000004:00000024:1.0:1787832964.562633:0:14435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787832964.562783:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+7:13848:x1874678283087360:12345-192.168.201.34@tcp:41:lfs.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.562792:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:2.0:1787832964.563282:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832964.566057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.566141:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087488 00000100:00100000:0.0:1787832964.566153:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087488 00000100:00100000:0.0:1787832964.566235:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832964.566247:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5446e631-f40d-43fa-8297-9fb53157ce22+5:13848:x1874678283087488:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:0.0:1787832964.566300:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832964.566391:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5446e631-f40d-43fa-8297-9fb53157ce22+5:13848:x1874678283087488:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 145us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.566399:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00080000:2.0:1787832964.566527:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832964.568433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.568812:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087616 00000100:00100000:0.0:1787832964.568821:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087616 00000100:00100000:0.0:1787832964.568898:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787832964.568928:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5446e631-f40d-43fa-8297-9fb53157ce22+6:13848:x1874678283087616:12345-192.168.201.34@tcp:13:lfs.0 00002000:00000024:0.0:1787832964.568967:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832964.569052:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5446e631-f40d-43fa-8297-9fb53157ce22+6:13848:x1874678283087616:12345-192.168.201.34@tcp:13:lfs.0 Request processed in 135us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.569060:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00080000:2.0:1787832964.569975:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832964.762445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.762746:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087744 00000100:00100000:1.0:1787832964.763574:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087744 00000100:00100000:1.0:1787832964.763677:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:1.0:1787832964.763689:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+10:13881:x1874678283087744:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787832964.763739:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832964.764987:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41c00/0x72bd9178b14b800c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b5d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.765031:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41c00/0x72bd9178b14b800c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b5d expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.765059:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41c00/0x72bd9178b14b800c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b5d expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.765070:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41c00, rc 0) 00000100:00100000:1.0:1787832964.765167:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283087744:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 1480us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.765176:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 91 00000100:00100000:3.0:1787832964.783880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.785389:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283087872 00000100:00100000:0.0:1787832964.785406:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283087872 00000100:00100000:0.0:1787832964.785504:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:0.0:1787832964.785515:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283087872:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787832964.786169:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283087872:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 651us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.786179:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 92 00000100:00100000:3.0:1787832964.792967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.793210:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088000 00000100:00100000:1.0:1787832964.793223:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088000 00000100:00100000:1.0:1787832964.793305:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:1.0:1787832964.793317:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283088000:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787832964.793924:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283088000:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 606us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.793935:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 93 00000100:00100000:3.0:1787832964.801271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.801812:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088128 00000100:00100000:1.0:1787832964.801823:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088128 00000100:00100000:1.0:1787832964.801911:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:1.0:1787832964.801922:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13887:x1874678283088128:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787832964.802487:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13887:x1874678283088128:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 565us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.802498:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 94 00000100:00100000:3.0:1787832964.819890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.820089:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088256 00000100:00100000:0.0:1787832964.820111:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088256 00000100:00100000:0.0:1787832964.820175:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1787832964.820186:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13887:x1874678283088256:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787832964.820574:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13887:x1874678283088256:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 388us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.820593:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 95 00000100:00100000:0.0:1787832964.824192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.824477:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088384 00000100:00100000:1.0:1787832964.824488:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088384 00000100:00100000:1.0:1787832964.824550:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:1.0:1787832964.824560:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13881:x1874678283088384:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787832964.824579:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832964.824600:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b8013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b87 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.824814:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b8013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b87 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.824828:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad41a00/0x72bd9178b14b8013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b87 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.824838:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41a00, rc 0) 00000100:00100000:1.0:1787832964.825740:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13881:x1874678283088384:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 1174us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.825751:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 96 00000100:00100000:1.0:1787832964.830196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832964.830438:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088512 00000100:00100000:3.0:1787832964.830450:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088512 00000100:00100000:1.0:1787832964.830640:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:1.0:1787832964.830655:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13881:x1874678283088512:12345-192.168.201.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787832964.830739:0:14428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787832964.830763:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787832964.830767:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787832964.830771:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787832964.830774:0:14428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787832964.835946:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13881:x1874678283088512:12345-192.168.201.34@tcp:256:mount.lustre.0 Request processed in 5278us (5748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.835967:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 97 00000100:00100000:3.0:1787832964.839123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.839792:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088640 00000100:00100000:1.0:1787832964.839803:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088640 00000100:00100000:1.0:1787832964.839904:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:1.0:1787832964.839912:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b4b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13881:x1874678283088640:12345-192.168.201.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787832964.839929:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832964.839948:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706b8e expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.839975:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.839984:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832964.839991:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40800, rc 0) 00000100:00100000:1.0:1787832964.840075:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b4b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13881:x1874678283088640:12345-192.168.201.34@tcp:101:mount.lustre.0 Request processed in 161us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.840082:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 98 00000100:00100000:3.0:1787832964.845208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.845524:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088768 00000100:00100000:1.0:1787832964.845554:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088768 00000100:00100000:1.0:1787832964.845609:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:1.0:1787832964.845681:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13881:x1874678283088768:12345-192.168.201.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787832964.846056:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13881:x1874678283088768:12345-192.168.201.34@tcp:501:mount.lustre.0 Request processed in 436us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.846066:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 99 00000100:00100000:3.0:1787832964.848750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.849003:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283088896 00000100:00100000:1.0:1787832964.849014:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283088896 00000100:00100000:1.0:1787832964.849158:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:1.0:1787832964.849170:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13881:x1874678283088896:12345-192.168.201.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787832964.849541:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13881:x1874678283088896:12345-192.168.201.34@tcp:503:mount.lustre.0 Request processed in 373us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.849550:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 100 00000100:00100000:3.0:1787832964.852182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.852396:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089024 00000100:00100000:0.0:1787832964.852408:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089024 00000100:00100000:0.0:1787832964.852480:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:0.0:1787832964.852490:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13892:x1874678283089024:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787832964.852891:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13892:x1874678283089024:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 402us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.852900:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 101 00000100:00100000:3.0:1787832964.856455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.856575:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089152 00000100:00100000:1.0:1787832964.856586:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089152 00000100:00100000:1.0:1787832964.856653:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:1.0:1787832964.856663:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13892:x1874678283089152:12345-192.168.201.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787832964.857018:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13892:x1874678283089152:12345-192.168.201.34@tcp:502:llog_process_th.0 Request processed in 355us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.857026:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 102 00000100:00100000:3.0:1787832964.863179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832964.863309:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089280 00000100:00100000:0.0:1787832964.863319:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089280 00000100:00100000:0.0:1787832964.863378:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787832964.863387:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874678283089280:12345-192.168.201.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787832964.863424:0:14436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2ff6567d-af40-4908-85d0-cd5fc99f89cd@192.168.201.34@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787832964.863480:0:14436:0:(genops.c:1385:class_connect()) connect: client 2ff6567d-af40-4908-85d0-cd5fc99f89cd, cookie 0x72bd9178b14b8021 00000004:00100000:0.0:1787832964.863522:0:14436:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787832964.864108:0:14436:0:(import.c:65:import_set_state_nolock()) ffff8c35436a0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787832964.864246:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2351:x1874678283089280:12345-192.168.201.34@tcp:38:mount.lustre.0 Request processed in 851us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832964.864256:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787832964.868516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832964.868734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.876991:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089408 00000100:00100000:1.0:1787832964.877009:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089408 00000100:00100000:1.0:1787832964.877179:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089536 00000100:00100000:1.0:1787832964.877184:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089536 00000100:00100000:1.0:1787832964.877224:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:1.0:1787832964.877235:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:0:x1874678283089408:12345-192.168.201.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787832964.877296:0:14435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787832964.877360:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787832964.877373:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:13881:x1874678283089536:12345-192.168.201.34@tcp:41:mount.lustre.0 00000100:00100000:1.0:1787832964.877387:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:0:x1874678283089408:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 152us (8884us total) trans 0 rc 0/0 00000004:00000024:3.0:1787832964.877390:0:14434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787832964.877398:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787832964.877433:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13881:x1874678283089536:12345-192.168.201.34@tcp:41:mount.lustre.0 Request processed in 63us (8729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832964.877442:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00010000:00010000:1.0:1787832964.877478:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787832964.877519:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787832964.879420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832964.879560:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089664 00000100:00100000:1.0:1787832964.879569:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089664 00000100:00100000:1.0:1787832964.879627:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787832964.879638:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13881:x1874678283089664:12345-192.168.201.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787832964.879880:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13881:x1874678283089664:12345-192.168.201.34@tcp:40:mount.lustre.0 Request processed in 243us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832964.879889:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832964.886798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832964.886854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832964.886912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832964.887041:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090048 00000100:00100000:3.0:1787832964.887053:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090048 00000100:00100000:3.0:1787832964.887127:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1787832964.887139:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13881:x1874678283090048:12345-192.168.201.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787832964.887483:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787832964.887655:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13881:x1874678283090048:12345-192.168.201.34@tcp:33:mount.lustre.0 Request processed in 517us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832964.887664:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:3.0:1787832964.887692:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089792 00000100:00100000:3.0:1787832964.887696:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089792 00000100:00100000:3.0:1787832964.887745:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283089920 00000100:00100000:3.0:1787832964.887748:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283089920 00000100:00100000:3.0:1787832964.887764:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787832964.887769:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678283089792:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787832964.887797:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2ff6567d-af40-4908-85d0-cd5fc99f89cd@192.168.201.34@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1787832964.887834:0:15116:0:(genops.c:1385:class_connect()) connect: client 2ff6567d-af40-4908-85d0-cd5fc99f89cd, cookie 0x72bd9178b14b8028 00002000:00100000:3.0:1787832964.887849:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ff6567d-af40-4908-85d0-cd5fc99f89cd/ffff8c344221e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787832964.887864:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787832964.888083:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787832964.888116:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8c344221c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787832964.888148:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2351:x1874678283089792:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 378us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832964.888155:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:3.0:1787832964.888167:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787832964.888171:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874678283089920:12345-192.168.201.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787832964.888186:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2ff6567d-af40-4908-85d0-cd5fc99f89cd@192.168.201.34@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1787832964.888209:0:15116:0:(genops.c:1385:class_connect()) connect: client 2ff6567d-af40-4908-85d0-cd5fc99f89cd, cookie 0x72bd9178b14b802f 00002000:00100000:3.0:1787832964.888214:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ff6567d-af40-4908-85d0-cd5fc99f89cd/ffff8c344221d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787832964.888220:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787832964.888290:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787832964.888306:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8c344221a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787832964.888331:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2351:x1874678283089920:12345-192.168.201.34@tcp:8:mount.lustre.0 Request processed in 158us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832964.888339:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832965.071937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832965.072072:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090176 00000100:00100000:0.0:1787832965.072082:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090176 00000100:00100000:0.0:1787832965.072157:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832965.072168:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:13913:x1874678283090176:12345-192.168.201.34@tcp:101:mkdir.0 00010000:00010000:0.0:1787832965.072194:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832965.072252:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00e00/0x72bd9178b14b8036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bb8 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832965.072344:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832965.072359:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832965.072375:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832965.072654:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787832965.072659:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832965.082503:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832965.082584:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00e00/0x72bd9178b14b8036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 8 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832965.082613:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 7 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832965.082623:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:1.0:1787832965.082627:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832965.082630:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a00c00, rc 0) 00000100:00100000:1.0:1787832965.083148:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:13913:x1874678283090176:12345-192.168.201.34@tcp:101:mkdir.0 Request processed in 10977us (11222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832965.083158:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832965.389047:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832965.393101:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3565b6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300904704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832965.394893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832965.399483:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904704 00000100:00100000:3.0:1787832965.399505:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904704 00000100:00100000:3.0:1787832965.400757:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787832965.400778:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300904704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787832965.400816:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832965.400930:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300904704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832965.400938:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832965.402507:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3565b6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300904704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787832965.404473:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787832965.910961:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787832966.923918:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787832967.308415:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787832967.440393:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440524:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300905344:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440576:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787832967.440581:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300904960:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440619:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35660943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300905472:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440667:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300905088:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440741:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787832967.440746:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300905216:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.440802:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904832 00000100:00100000:0.0:1787832967.440810:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904832 00000100:00100000:0.0:1787832967.440864:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787832967.440874:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300904832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.440930:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300904832:12345-0@lo:400:kworker.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832967.440938:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787832967.440971:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905344 00000100:00100000:0.0:1787832967.440974:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905344 00000100:00100000:0.0:1787832967.443482:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905472 00000100:00100000:0.0:1787832967.443496:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905472 00000100:00100000:2.0:1787832967.444082:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905216 00000100:00100000:2.0:1787832967.444089:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905216 00000100:00100000:2.0:1787832967.444120:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787832967.444129:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300905344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832967.444237:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300905344:12345-0@lo:400:kworker.0 Request processed in 109us (3685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832967.444244:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787832967.444262:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787832967.444269:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300905216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787832967.444310:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300905216:12345-0@lo:400:kworker.0 Request processed in 41us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832967.444317:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787832967.454780:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787832967.461457:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787832967.461481:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300905472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.461629:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300905472:12345-0@lo:400:kworker.0 Request processed in 152us (20984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832967.461637:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787832967.461676:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300904960 00000100:00100000:0.0:1787832967.461686:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300904960 00000100:00100000:0.0:1787832967.461750:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905088 00000100:00100000:0.0:1787832967.461757:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905088 00000100:00100000:0.0:1787832967.461787:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787832967.461805:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300904960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.461851:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300904960:12345-0@lo:400:kworker.0 Request processed in 50us (21246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832967.461881:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787832967.461900:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787832967.461907:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300905088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.461949:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300905088:12345-0@lo:400:kworker.0 Request processed in 43us (21250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832967.461958:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787832967.462042:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832967.462046:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832967.462070:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787832967.462089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300905600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832967.462132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832967.462174:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905600 00000100:00100000:0.0:1787832967.462178:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905600 00000100:00100000:0.0:1787832967.462202:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832967.462209:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300905600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787832967.462239:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832967.462276:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300905600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832967.462281:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832967.462344:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787832967.462369:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300905600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832967.462406:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300905216:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.462415:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300905088:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.462454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300904960:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.462477:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35660943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300905472:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.462488:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787832967.462499:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300905344:0@lo:400:kworker.0 00000001:00100000:2.0:1787832967.501849:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5446e631-f40d-43fa-8297-9fb53157ce22 00000001:00100000:2.0:1787832967.501866:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ff6567d-af40-4908-85d0-cd5fc99f89cd 00000001:02000400:3.0:1787832967.872115:0:16392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787832967.948025:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787832968.007321:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2ff6567d-af40-4908-85d0-cd5fc99f89cd 00000001:00100000:0.0:1787832968.007335:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5446e631-f40d-43fa-8297-9fb53157ce22 00000001:00100000:3.0:1787832968.574877:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ff6567d-af40-4908-85d0-cd5fc99f89cd 00010000:00010000:3.0:1787832968.971954:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832969.997541:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832970.235270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.235318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.235351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.235385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.235413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.235450:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090688 00000100:00100000:3.0:1787832970.235461:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090688 00000100:00100000:3.0:1787832970.235517:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090944 00000100:00100000:3.0:1787832970.235520:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090944 00000100:00100000:3.0:1787832970.235534:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090560 00000100:00100000:3.0:1787832970.235536:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090560 00000100:00100000:3.0:1787832970.235553:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787832970.235563:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283090688:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832970.235636:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283090688:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 75us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832970.235644:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:3.0:1787832970.235662:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832970.235669:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283090944:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832970.235693:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283090944:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832970.235698:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832970.235767:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787832970.235774:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283090560:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832970.235799:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283090560:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832970.235805:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:3.0:1787832970.235823:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090304 00000100:00100000:3.0:1787832970.235827:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090304 00000100:00100000:3.0:1787832970.235853:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00100000:3.0:1787832970.235860:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283090304:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832970.235883:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283090304:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832970.235896:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 104 00000100:00080000:3.0:1787832970.235928:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787832970.235933:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832970.236447:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090432 00000100:00100000:1.0:1787832970.236453:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090432 00000100:00100000:1.0:1787832970.236506:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:1.0:1787832970.236514:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:2352:x1874678283090432:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832970.236553:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565b6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:2352:x1874678283090432:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 40us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832970.236560:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00080000:3.0:1787832970.237225:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832970.238119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832970.238228:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283090816 00000100:00100000:1.0:1787832970.238236:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283090816 00000100:00100000:1.0:1787832970.238330:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1787832970.238341:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283090816:12345-192.168.201.34@tcp:400:kworker.0 00000100:00080000:2.0:1787832970.239826:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832970.242039:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283090816:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 3688us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832970.242056:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787832970.244093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832970.249951:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091072 00000100:00100000:3.0:1787832970.249968:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091072 00000100:00100000:3.0:1787832970.250048:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:3.0:1787832970.250059:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283091072:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832970.250159:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283091072:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 101us (6073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832970.250168:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00080000:3.0:1787832970.250288:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787832970.507926:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566095e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300905728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787832970.508035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832970.508279:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300905728 00000100:00100000:0.0:1787832970.508289:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300905728 00000100:00100000:0.0:1787832970.508362:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787832970.508373:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300905728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787832970.508421:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787832970.508471:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300905728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832970.508478:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787832970.508610:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832970.508652:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566095e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300905728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787832971.025465:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787832971.298335:0:16541:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebd8a6c30 20000000:00000080:3.0:1787832971.298358:0:16541:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3441cbbc00 uarg=0000000000000000 20000000:01000000:3.0:1787832971.298404:0:16541:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787832971.298411:0:16541:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787832971.298417:0:16541:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787832971.304727:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787832971.304867:0:16541:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787832971.308399:0:16541:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787832971.308437:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308459:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308467:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308488:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308497:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308504:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308512:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308563:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308580:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 12 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.308597:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300905856:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832971.308743:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308753:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 12 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.308762:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb76580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300905984:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832971.308807:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.308826:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.308836:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906112:0@lo:104: 00000100:00100000:3.0:1787832971.308876:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787832971.308917:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832971.309231:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906112 00000100:00100000:1.0:1787832971.309243:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906112 00000100:00100000:1.0:1787832971.309363:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787832971.309387:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906112:12345-0@lo:104: 00010000:00010000:1.0:1787832971.309408:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.309521:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832971.309528:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906112:12345-0@lo:104: Request processed in 156us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832971.309536:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787832971.309829:0:15750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832971.309838:0:15750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.309846:0:15750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1787832971.309851:0:15750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.309861:0:15750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787832971.309881:0:15750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787832971.309888:0:15750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787832971.309941:0:15750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.309948:0:15750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787832971.309969:0:15750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.309977:0:15750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad40400/0x72bd9178b14b7eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7ebc expref: -99 pid: 15831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.310009:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832971.310011:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832971.310013:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832971.310038:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300906368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787832971.310081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832971.314858:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906368 00000100:00100000:2.0:1787832971.314878:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906368 00010000:00010000:2.0:1787832971.314968:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 19 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832971.315034:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787832971.315045:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300906368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832971.315063:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832971.315070:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 19 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.321941:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 19 pid: 14427 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.321964:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906240:0@lo:104: 00010000:00010000:2.0:1787832971.323879:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 19 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832971.323918:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832971.324021:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832971.328421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832971.328470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832971.328524:0:14420:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787832971.328537:0:14420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787832971.328573:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787832971.328589:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091200 00000100:00100000:0.0:1787832971.328597:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091200 00010000:00010000:0.0:1787832971.328634:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 13 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832971.328683:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787832971.328688:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091328 00000100:00100000:0.0:1787832971.328691:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091328 00010000:00010000:0.0:1787832971.329944:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 14 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832971.329979:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787832971.330189:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832971.330206:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c657dfb7-0284-47b4-ac0a-5336a0328df6+14:2352:x1874678283091200:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832971.330228:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832971.330236:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 14 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.330253:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 14 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.330281:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832971.330372:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c657dfb7-0284-47b4-ac0a-5336a0328df6+14:2352:x1874678283091200:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 173us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832971.330382:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:0.0:1787832971.330406:0:14419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787832971.330415:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:0.0:1787832971.330426:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283091328:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832971.330436:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832971.330441:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 13 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.330469:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 13 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.330480:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832971.330505:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283091328:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 82us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832971.330514:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:2.0:1787832971.330973:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906240 00000100:00100000:2.0:1787832971.330982:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906240 00010000:00010000:3.0:1787832971.331260:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.331386:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 19 pid: 14428 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.331405:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb77c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906496:0@lo:104: 00000100:00100000:2.0:1787832971.331542:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787832971.331552:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906240:12345-0@lo:104: 00010000:00010000:2.0:1787832971.331578:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832971.331663:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787832971.331681:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906240:12345-0@lo:104: Request processed in 130us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832971.331689:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787832971.331697:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832971.331724:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.331734:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610ae00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832971.331738:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.331750:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832971.331758:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832971.331765:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787832971.331772:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300906368:12345-0@lo:103:ldlm_bl.0 Request processed in 16727us (21687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832971.331783:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787832971.331811:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.331820:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832971.331848:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.331857:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c356610ae00/0x72bd9178b14b7d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d88 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.331885:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832971.331887:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832971.331889:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832971.332011:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832971.332044:0:16541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787832971.332085:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40800/0x72bd9178b14b801a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b8e expref: 12 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.332097:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300905856:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832971.332110:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3443a01e00/0x72bd9178b14b7fe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b2c expref: 11 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.332130:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb76580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300905984:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832971.332144:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad40e00/0x72bd9178b14b7ebc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7eb5 expref: 18 pid: 14429 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.332153:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906112:0@lo:104: 00000100:00100000:3.0:1787832971.332162:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906240:0@lo:104: 00000100:00100000:0.0:1787832971.335359:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300906368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787832971.335398:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832971.335411:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300906624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787832971.335491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832971.335592:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906624 00000100:00100000:0.0:1787832971.335599:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906624 00010000:00010000:0.0:1787832971.335640:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832971.335684:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787832971.335694:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea647735-d55a-4124-bae8-f7db9715e04e+18:3307:x1874678300906624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787832971.335738:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832971.335745:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.335758:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.335780:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c357ad41000/0x72bd9178b14b7d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7d81 expref: 18 pid: 14427 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832971.335819:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832971.335856:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea647735-d55a-4124-bae8-f7db9715e04e+17:3307:x1874678300906624:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832971.335864:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787832971.337035:0:14417:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787832971.337064:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906496 00000100:00100000:1.0:1787832971.337074:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906496 00000100:00100000:1.0:1787832971.337132:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787832971.337144:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565129c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906496:12345-0@lo:104: 00010000:00010000:1.0:1787832971.337164:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337256:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787832971.337262:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565129c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ea647735-d55a-4124-bae8-f7db9715e04e+3:16541:x1874678300906496:12345-0@lo:104: Request processed in 122us (5601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832971.337269:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787832971.337321:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787832971.337328:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337336:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1787832971.337340:0:14422:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337349:0:14422:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787832971.337358:0:14422:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787832971.337381:0:14422:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787832971.337422:0:14422:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337429:0:14422:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787832971.337447:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337454:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.134@tcp lock: ffff8c357ad41400/0x72bd9178b14b7d34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72bd9178b14b7d3b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832971.337480:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832971.337482:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787832971.337483:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832971.337490:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787832971.337503:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300906752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787832971.337535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832971.337750:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906752 00000100:00100000:3.0:1787832971.337755:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906752 00010000:00010000:3.0:1787832971.337774:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 17 pid: 14428 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832971.337796:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787832971.337801:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+17:3306:x1874678300906752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832971.337811:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832971.337816:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 17 pid: 14428 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337826:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 17 pid: 14428 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337845:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337854:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337868:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337885:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337892:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337898:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337903:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86e00 already unused, calling callback (ffffffffc160a420) 00010000:00010000:3.0:1787832971.337907:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337913:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337930:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832971.337941:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787832971.337984:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ea647735-d55a-4124-bae8-f7db9715e04e+17:3306:x1874678300906752:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832971.337990:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787832971.338363:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300906624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787832971.338545:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356610a200/0x72bd9178b14b7d3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72bd9178b14b7d34 expref: 16 pid: 14428 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832971.338561:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb77c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1874678300906496:0@lo:104: 00010000:00010000:2.0:1787832971.338614:0:16541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832971.338625:0:16541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832971.338632:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832971.338638:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b8044 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832971.349388:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300906752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787832972.048198:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832972.558355:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300907008:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.558482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832972.558575:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832972.558584:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300907136:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.558616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832972.558733:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907008 00000100:00100000:0.0:1787832972.558742:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907008 00000100:00100000:0.0:1787832972.558826:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907136 00000100:00100000:0.0:1787832972.558830:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907136 00000100:00100000:0.0:1787832972.558871:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787832972.558882:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300907008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832972.559281:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300906880:0@lo:400:kworker.0 00000100:00100000:3.0:1787832972.559359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832972.559406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300907520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832972.559433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832972.559471:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787832972.559478:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300907264:0@lo:400:kworker.0 00000100:00100000:3.0:1787832972.559503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832972.559536:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907264 00000100:00100000:3.0:1787832972.559542:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907264 00000100:00100000:3.0:1787832972.559589:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787832972.559598:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300907264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832972.559649:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874678300907264:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832972.559656:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787832972.559719:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874678300907264:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.560529:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300907008:12345-0@lo:400:kworker.0 Request processed in 84us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832972.560545:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787832972.561302:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787832972.561319:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300907136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787832972.568783:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787832972.568793:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832972.568939:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300907392:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.569638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832972.569734:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907392 00000100:00100000:1.0:1787832972.569748:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907392 00000100:00100000:0.0:1787832972.569785:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300907008:0@lo:400:kworker.0 00000100:00100000:1.0:1787832972.569836:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832972.569851:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300907392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832972.569958:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300907392:12345-0@lo:400:kworker.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832972.570602:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787832972.570638:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832972.571144:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907520 00000100:00100000:1.0:1787832972.571152:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907520 00000100:00100000:1.0:1787832972.571197:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832972.571207:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300907520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787832972.571246:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832972.571328:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300907520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (11891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832972.571336:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787832972.571360:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300906880 00000100:00100000:1.0:1787832972.571364:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300906880 00000100:00100000:1.0:1787832972.571392:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787832972.571399:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:3306:x1874678300906880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832972.571432:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+16:3306:x1874678300906880:12345-0@lo:400:kworker.0 Request processed in 33us (12073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832972.571439:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787832972.571624:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300906880:0@lo:400:kworker.0 00000100:00100000:3.0:1787832972.571657:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300907520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832972.571668:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787832972.571698:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300907648:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.571776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832972.571839:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300907392:0@lo:400:kworker.0 00000100:00100000:0.0:1787832972.571972:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300907136:12345-0@lo:400:kworker.0 Request processed in 10659us (13354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832972.571984:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787832972.572022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb76d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300907136:0@lo:400:kworker.0 00000100:00100000:1.0:1787832972.572225:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907648 00000100:00100000:1.0:1787832972.572231:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907648 00000100:00100000:1.0:1787832972.572354:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787832972.572362:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300907648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832972.572413:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874678300907648:12345-0@lo:400:kworker.0 Request processed in 52us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832972.572420:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787832972.573819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874678300907648:0@lo:400:kworker.0 00000100:00080000:0.0:1787832972.573864:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787832973.068174:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787832973.068978:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787832973.068983:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3566261800 from 10 10000000:01000000:2.0:1787832973.068989:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787832973.069038:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832973.069050:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832973.069075:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832973.069105:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300907776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787832973.069178:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832973.069237:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35520d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.070934:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907776 00000100:00100000:3.0:1787832973.070947:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907776 00000100:00100000:3.0:1787832973.071015:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787832973.071026:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+16:14431:x1874678300907776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.071043:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832973.071065:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86600/0x72bd9178b14b8052 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b804b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.071098:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86600/0x72bd9178b14b8052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b804b expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.071109:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86600/0x72bd9178b14b8052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b804b expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.071131:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86600, rc 0) 00000100:00100000:3.0:1787832973.071208:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300907776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.071215:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787832973.071280:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300907776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.071298:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8052 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.071309:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b8052 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.071401:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300907904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.071451:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.071482:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.071496:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300907904 00000100:00100000:3.0:1787832973.071500:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300907904 00000100:00100000:3.0:1787832973.071524:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787832973.071531:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300907904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.071805:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300907904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.071812:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787832973.071843:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300907904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.071875:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.071927:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.071949:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.071960:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908032 00000100:00100000:3.0:1787832973.071964:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908032 00000100:00100000:3.0:1787832973.071984:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787832973.071990:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300908032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.072141:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300908032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.072148:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787832973.072187:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787832973.072815:0:16620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787832973.072865:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787832973.072881:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787832973.072902:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8052 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.072911:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356610b800/0x72bd9178b14b804b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8052 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832973.072921:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787832973.072923:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3542f87800 from 10 10000000:01000000:3.0:1787832973.072926:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787832973.072953:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.072962:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.072970:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.072996:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073032:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.073050:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.073064:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908160 00000100:00100000:3.0:1787832973.073068:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908160 00000100:00100000:3.0:1787832973.073091:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787832973.073099:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+17:14431:x1874678300908160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.073107:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832973.073120:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc87800/0x72bd9178b14b8060 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b8059 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.073140:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc87800/0x72bd9178b14b8060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b8059 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.073151:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc87800/0x72bd9178b14b8060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b8059 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.073160:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc87800, rc 0) 00000100:00100000:3.0:1787832973.073191:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.073197:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787832973.073230:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.073242:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8060 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.073250:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b8060 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.073297:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073322:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.073336:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.073347:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908288 00000100:00100000:3.0:1787832973.073350:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908288 00000100:00100000:3.0:1787832973.073370:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832973.073376:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073557:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.073565:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787832973.073594:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073617:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073650:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.073664:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.073675:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908416 00000100:00100000:3.0:1787832973.073678:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908416 00000100:00100000:3.0:1787832973.073718:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787832973.073725:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.073847:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.073854:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787832973.086076:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787832973.087113:0:16622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787832973.087206:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787832973.087228:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787832973.087240:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8060 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.087252:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc87000/0x72bd9178b14b8059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b8060 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787832973.087264:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787832973.087267:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c357b0a7000 from 10 10000000:01000000:3.0:1787832973.087270:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787832973.087315:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.087324:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.087334:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.087363:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.087650:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.087697:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.087742:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908544 00000100:00100000:3.0:1787832973.088899:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908544 00000100:00100000:3.0:1787832973.088969:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787832973.088980:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+18:14431:x1874678300908544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.088997:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832973.089017:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b806e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72bd9178b14b8067 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.089063:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b806e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72bd9178b14b8067 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.089075:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356bc86e00/0x72bd9178b14b806e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72bd9178b14b8067 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.089084:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86e00, rc 0) 00000100:00100000:3.0:1787832973.089157:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300908544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.089164:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787832973.089231:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787832973.089248:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b806e expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832973.089257:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72bd9178b14b806e expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.089321:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.089354:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832973.089379:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.089393:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908672 00000100:00100000:3.0:1787832973.089397:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908672 00000100:00100000:3.0:1787832973.089418:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787832973.089425:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300908672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.091232:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300908672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1800us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.091256:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787832973.091555:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832973.091608:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35660952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832973.091657:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832973.091694:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3573924000 going to sleep for 11 seconds 00000100:00100000:3.0:1787832973.093885:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300908800 00000100:00100000:3.0:1787832973.093908:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300908800 00000100:00100000:3.0:1787832973.093963:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787832973.093974:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300908800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.094200:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea647735-d55a-4124-bae8-f7db9715e04e+19:14431:x1874678300908800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.094209:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787832973.094283:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35660952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ea647735-d55a-4124-bae8-f7db9715e04e:14431:1874678300908800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787832973.097636:0:16623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787832973.097990:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787832973.098011:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787832973.098023:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b806e expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832973.098036:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.134@tcp lock: ffff8c356bc86c00/0x72bd9178b14b8067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72bd9178b14b806e expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832973.243148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832973.244157:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091456 00000100:00100000:2.0:1787832973.244170:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091456 00000100:00100000:2.0:1787832973.244231:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:2.0:1787832973.244244:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+11:13768:x1874678283091456:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787832973.244265:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832973.244285:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c356610a000/0x72bd9178b14b8075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bbf expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832973.244320:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c356610a000/0x72bd9178b14b8075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bbf expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832973.244334:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c356610a000/0x72bd9178b14b8075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bbf expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832973.244344:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a000, rc 0) 00000100:00100000:2.0:1787832973.244420:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091456:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 179us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832973.244427:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 115 00000100:00100000:1.0:1787832973.255562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832973.256548:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091584 00000100:00100000:0.0:1787832973.256560:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091584 00000100:00100000:0.0:1787832973.257129:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:0.0:1787832973.257142:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091584:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787832973.259736:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091584:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 2586us (4171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832973.259761:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 116 00000100:00100000:3.0:1787832973.266879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832973.276093:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091712 00000100:00100000:0.0:1787832973.276111:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091712 00000100:00100000:0.0:1787832973.276225:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:0.0:1787832973.276239:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091712:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832973.276491:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091712:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 256us (9623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832973.276501:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 117 00000100:00100000:3.0:1787832973.295662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832973.298952:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091840 00000100:00100000:0.0:1787832973.298970:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091840 00000100:00100000:0.0:1787832973.299041:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1787832973.299052:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+12:13768:x1874678283091840:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787832973.299072:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832973.299094:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3443a01600/0x72bd9178b14b807c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bc6 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832973.299131:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3443a01600/0x72bd9178b14b807c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bc6 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832973.299144:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3443a01600/0x72bd9178b14b807c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bc6 expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832973.299155:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a01600, rc 0) 00000100:00100000:0.0:1787832973.299240:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13768:x1874678283091840:12345-192.168.201.34@tcp:101:ll_cfg_requeue.0 Request processed in 189us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832973.299270:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 118 00000100:00100000:0.0:1787832973.314027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832973.314099:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283091968 00000100:00100000:3.0:1787832973.314111:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283091968 00000100:00100000:3.0:1787832973.314175:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1787832973.314187:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13768:x1874678283091968:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787832973.314514:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13768:x1874678283091968:12345-192.168.201.34@tcp:501:ll_cfg_requeue.0 Request processed in 329us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832973.314524:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 119 00000100:00100000:3.0:1787832973.320171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832973.320418:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092096 00000100:00100000:0.0:1787832973.320430:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092096 00000100:00100000:0.0:1787832973.320494:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 120 00000100:00100000:0.0:1787832973.320505:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13768:x1874678283092096:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787832973.320775:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:13768:x1874678283092096:12345-192.168.201.34@tcp:503:ll_cfg_requeue.0 Request processed in 271us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832973.320784:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 120 00010000:00010000:1.0:1787832974.091948:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787832975.116488:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832975.359156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.359390:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092736 00000100:00100000:3.0:1787832975.359400:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092736 00000100:00100000:3.0:1787832975.359466:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092352 00000100:00100000:3.0:1787832975.359470:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092352 00000100:00100000:3.0:1787832975.359578:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787832975.359591:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283092736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832975.359739:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283092736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 111us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.359749:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:3.0:1787832975.359770:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1787832975.359778:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+6:2352:x1874678283092352:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:3.0:1787832975.359805:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+6:2352:x1874678283092352:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.359811:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:1.0:1787832975.360403:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092224 00000100:00100000:1.0:1787832975.360410:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092224 00000100:00100000:1.0:1787832975.360458:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:1.0:1787832975.360491:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283092224:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832975.360533:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283092224:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 54us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.360540:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 121 00000100:00100000:1.0:1787832975.360575:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092480 00000100:00100000:1.0:1787832975.360579:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092480 00000100:00100000:1.0:1787832975.360603:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092992 00000100:00100000:1.0:1787832975.360606:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092992 00000100:00100000:1.0:1787832975.360622:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092608 00000100:00100000:1.0:1787832975.360625:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092608 00000100:00100000:1.0:1787832975.360637:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283092864 00000100:00100000:1.0:1787832975.360640:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283092864 00000100:00100000:1.0:1787832975.360654:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1787832975.361024:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832975.361036:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283092992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832975.361086:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283092992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 54us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.361093:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832975.361106:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832975.361112:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283092608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832975.361149:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283092608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 37us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.361156:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832975.361168:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787832975.361174:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283092864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:0.0:1787832975.361198:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283092864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 25us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.361216:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00080000:0.0:1787832975.361236:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832975.361240:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787832975.361243:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832975.362365:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283092480:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832975.363583:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283092480:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 2914us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.363599:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787832975.431288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832975.431421:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283093120 00000100:00100000:0.0:1787832975.431431:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283093120 00000100:00100000:0.0:1787832975.431505:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787832975.431516:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357bb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+6:14423:x1874678283093120:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832975.431541:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832975.431565:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00e00/0x72bd9178b14b8083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bcd expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.431648:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.431664:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.431678:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.431903:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.431911:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.432034:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.432874:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01c00/0x72bd9178b14b8098 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.432887:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01c00/0x72bd9178b14b8098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.432896:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01c00/0x72bd9178b14b8098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832975.433165:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787832975.433171:0:16067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832975.433277:0:16067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01c00/0x72bd9178b14b8098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433292:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433299:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433307:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433313:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832975.433317:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433326:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433340:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:0.0:1787832975.433350:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832975.433356:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433362:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00000/0x72bd9178b14b808a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433813:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433821:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433828:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433834:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832975.433837:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433843:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433862:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c3550109600) 00010000:00010000:0.0:1787832975.433865:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832975.433868:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433872:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b8091 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.433933:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00e00/0x72bd9178b14b8083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bcd expref: 8 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.434023:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01c00/0x72bd9178b14b8098 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bcd expref: 7 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.434030:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3550109f00) 00010000:00010000:0.0:1787832975.434033:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787832975.434035:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a01c00, rc 0) 00000100:00100000:0.0:1787832975.434138:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357bb77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+7:14423:x1874678283093120:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2623us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.434147:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:0.0:1787832975.451842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.451922:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283093376 00000100:00100000:1.0:1787832975.451934:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283093376 00000100:00100000:1.0:1787832975.452065:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787832975.452076:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:14423:x1874678283093376:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832975.452101:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832975.452132:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b809f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bd4 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.452223:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.452254:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.452264:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.453595:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.453622:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.453638:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454384:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b80b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454398:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b80b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454406:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b80b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.454419:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787832975.454952:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454961:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454968:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454979:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832975.454984:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.454992:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455006:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3550109f00) 00010000:00010000:1.0:1787832975.455009:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.455015:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455021:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455034:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455041:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455046:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455053:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832975.455056:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455063:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455082:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c3559189300) 00010000:00010000:1.0:1787832975.455084:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.455087:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455094:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b80ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455694:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b809f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bd4 expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455823:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41400/0x72bd9178b14b80b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bd4 expref: 9 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.455831:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3559189800) 00010000:00010000:1.0:1787832975.455834:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.455838:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41400, rc 0) 00000100:00100000:1.0:1787832975.455934:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+9:14423:x1874678283093376:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 3858us (4108us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787832975.455944:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787832975.470099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.473211:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283093504 00000100:00100000:3.0:1787832975.473230:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283093504 00000100:00100000:3.0:1787832975.473320:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:3.0:1787832975.473331:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+9:14423:x1874678283093504:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787832975.474716:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+9:14423:x1874678283093504:12345-192.168.201.34@tcp:59:lhsmtool_posix.0 Request processed in 1365us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.474731:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832975.484109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832975.484217:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283093632 00000100:00100000:2.0:1787832975.484228:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283093632 00000100:00100000:2.0:1787832975.484300:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787832975.484330:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+9:14429:x1874678283093632:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832975.484356:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832975.484380:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b80c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bdb expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484457:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484588:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484602:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484621:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484628:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.484635:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485195:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485204:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485212:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485228:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.485233:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485240:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485256:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:2.0:1787832975.485259:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.485265:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485272:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b80c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485289:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485295:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485302:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485307:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.485310:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485317:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485337:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3547ea9b00) 00010000:00010000:2.0:1787832975.485340:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.485343:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485349:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b80d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485388:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b80c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bdb expref: 10 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485400:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:2.0:1787832975.485402:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.485406:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b80c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bdb expref: 10 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.485415:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610ac00, rc 0) 00000100:00100000:2.0:1787832975.485608:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+9:14429:x1874678283093632:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1279us (1570us total) trans 0 rc 301/301 00000100:00100000:2.0:1787832975.485617:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832975.490055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.490226:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283093760 00000100:00100000:3.0:1787832975.490239:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283093760 00000100:00100000:3.0:1787832975.490359:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:3.0:1787832975.490372:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5446e631-f40d-43fa-8297-9fb53157ce22+9:14429:x1874678283093760:12345-192.168.201.34@tcp:700:lfs.0 00000100:00100000:3.0:1787832975.490484:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5446e631-f40d-43fa-8297-9fb53157ce22+9:14429:x1874678283093760:12345-192.168.201.34@tcp:700:lfs.0 Request processed in 115us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.490492:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1787832975.492673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832975.492868:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094016 00000100:00100000:0.0:1787832975.492877:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094016 00000100:00100000:0.0:1787832975.493040:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832975.493114:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+9:14429:x1874678283094016:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:0.0:1787832975.493183:0:16067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832975.493217:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b8005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706b56 expref: 9 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.493238:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:0.0:1787832975.493244:0:16067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787832975.493664:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.493681:0:16067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 5 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.493889:0:16067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.493942:0:16067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 5 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.493958:0:16067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 5 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.493973:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3566094780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300908928:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832975.494201:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3573924c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787832975.497763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.498423:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3566094780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300908928:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832975.498455:0:16067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832975.498657:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094144 00000100:00100000:2.0:1787832975.498665:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094144 00010000:00010000:2.0:1787832975.498833:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 6 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832975.498921:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:2.0:1787832975.498932:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283094144:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832975.498967:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832975.498975:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 6 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.498988:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 6 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.499012:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b803d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bb8 expref: 6 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.499029:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:2.0:1787832975.499034:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.499044:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.499060:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.499085:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832975.499145:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283094144:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 215us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832975.499153:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00010000:00010000:1.0:1787832975.499199:0:16067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.499207:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.499244:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.499255:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.499263:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.501771:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787832975.501796:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501807:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501816:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501822:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832975.501827:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501836:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501863:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3547ea9000) 00010000:00010000:1.0:1787832975.501867:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.501873:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.501891:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00600/0x72bd9178b14b80d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787832975.502391:0:16067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210390a4 reply state 0000000009438f03 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832975.502405:0:16067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787832975.502653:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+10:14429:x1874678283094016:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 9598us (9985us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787832975.502664:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000040:00080000:1.0:1787832975.504281:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787832975.515784:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515808:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515839:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515856:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.515862:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515871:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515890:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3559189300) 00010000:00010000:2.0:1787832975.515893:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.515899:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.515906:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.567871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.567979:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094272 00000100:00100000:1.0:1787832975.567991:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094272 00000100:00100000:1.0:1787832975.568061:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:1.0:1787832975.568070:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+9:14437:x1874678283094272:12345-192.168.201.34@tcp:101:lctl.0 00010000:00010000:1.0:1787832975.568097:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832975.568120:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b80e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706be2 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568188:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568199:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568208:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.568275:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787832975.568296:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832975.568346:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568369:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b80e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706be2 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568384:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40e00/0x72bd9178b14b80ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706be2 expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.568390:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:1.0:1787832975.568393:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832975.568395:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40e00, rc 0) 00000100:00100000:1.0:1787832975.568455:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+10:14437:x1874678283094272:12345-192.168.201.34@tcp:101:lctl.0 Request processed in 387us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.568459:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787832975.589156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.589241:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094400 00000100:00100000:3.0:1787832975.589251:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094400 00000100:00100000:3.0:1787832975.589319:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:3.0:1787832975.589330:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:14438:x1874678283094400:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832975.589357:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832975.589388:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b80f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706be9 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.589468:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b80fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.589485:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b80fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.589501:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b80fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832975.589579:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787832975.589600:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832975.589635:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b80fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.589665:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b80f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706be9 expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.590094:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86800/0x72bd9178b14b80fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706be9 expref: 6 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.590106:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:3.0:1787832975.590109:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787832975.590113:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86800, rc 0) 00000100:00100000:3.0:1787832975.590226:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35660952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:14438:x1874678283094400:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 897us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.590234:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:0.0:1787832975.597097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.597294:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094528 00000100:00100000:1.0:1787832975.597306:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094528 00000100:00100000:1.0:1787832975.597376:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:1.0:1787832975.597388:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:14438:x1874678283094528:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832975.597415:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832975.597438:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bf0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597520:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597535:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597571:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597588:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597596:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.597603:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599467:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599493:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599506:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.599584:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787832975.599589:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832975.599619:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599634:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599642:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599665:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599672:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832975.599676:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599684:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599697:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:1.0:1787832975.599717:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.599723:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599730:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599748:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599754:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599760:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599765:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832975.599768:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599784:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599794:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3559189f00) 00010000:00010000:1.0:1787832975.599796:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832975.599799:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599806:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b810f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599857:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bf0 expref: 8 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599875:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bf0 expref: 7 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.599882:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189000) 00010000:00010000:1.0:1787832975.599884:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832975.599887:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832975.600042:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:14438:x1874678283094528:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 2655us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.600053:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 22 00000100:00100000:0.0:1787832975.607169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.607252:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283094784 00000100:00100000:1.0:1787832975.607270:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283094784 00000100:00100000:1.0:1787832975.607351:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:1.0:1787832975.607365:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+7:14438:x1874678283094784:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832975.607407:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832975.607557:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b811d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bf7 expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.607687:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787832975.607888:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b811d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bf7 expref: 9 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.607917:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:1.0:1787832975.607920:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832975.607928:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b811d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bf7 expref: 9 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.607944:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40400, rc 0) 00000100:00100000:1.0:1787832975.608019:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ff6567d-af40-4908-85d0-cd5fc99f89cd+8:14438:x1874678283094784:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 658us (866us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787832975.608028:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 23 00000100:00100000:0.0:1787832975.612264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832975.613886:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283095040 00000100:00100000:2.0:1787832975.613903:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283095040 00000100:00100000:2.0:1787832975.614007:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 24 00000100:00100000:2.0:1787832975.614024:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+8:14438:x1874678283095040:12345-192.168.201.34@tcp:36:lfs.0 00010000:00010000:2.0:1787832975.614107:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832975.614141:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8116 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bf0 expref: 8 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.614167:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189000) 00010000:00010000:2.0:1787832975.614181:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832975.614233:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.614249:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.614260:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832975.614547:0:14434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a74cb7d1 reply state 000000008fe2db5a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832975.614557:0:14434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787832975.614572:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787832975.614684:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+9:14438:x1874678283095040:12345-192.168.201.34@tcp:36:lfs.0 Request processed in 665us (2431us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787832975.614693:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 24 00010000:00010000:2.0:1787832975.617113:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617136:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617145:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617151:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.617157:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617165:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617204:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3547ea9b00) 00010000:00010000:2.0:1787832975.617207:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787832975.617213:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.617220:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b812b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.617982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.618205:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283095296 00000100:00100000:3.0:1787832975.618216:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283095296 00000100:00100000:3.0:1787832975.618271:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:3.0:1787832975.618281:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+8:14438:x1874678283095296:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832975.618575:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+9:14438:x1874678283095296:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 295us (603us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787832975.618583:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1787832975.628023:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832975.628068:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c356579da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787832975.628155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832975.628351:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909056 00000100:00100000:1.0:1787832975.628360:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909056 00000100:00100000:1.0:1787832975.628437:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787832975.628446:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300909056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832975.628489:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832975.628544:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300909056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.628552:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787832975.628658:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787832975.628855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c356579da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787832975.636125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.636440:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283095552 00000100:00100000:3.0:1787832975.636455:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283095552 00000100:00100000:3.0:1787832975.636536:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:3.0:1787832975.636547:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+9:14438:x1874678283095552:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832975.636582:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832975.636627:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706bfe expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637009:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637027:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637041:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637129:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637138:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637145:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832975.637328:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787832975.637581:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637590:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637598:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637605:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832975.637611:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637630:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637821:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:3.0:1787832975.637825:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832975.637831:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637836:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637862:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637868:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637873:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637878:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832975.637881:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637886:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637893:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3543a9cd00) 00010000:00010000:3.0:1787832975.637896:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832975.637899:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.637975:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.638030:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8132 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bfe expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.638303:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:3.0:1787832975.638307:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832975.638312:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706bfe expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.638324:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86200, rc 0) 00000100:00100000:3.0:1787832975.638405:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+10:14438:x1874678283095552:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 1859us (2290us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787832975.638415:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 25 00000100:00100000:0.0:1787832975.646203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.646286:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283095680 00000100:00100000:1.0:1787832975.646301:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283095680 00000100:00100000:1.0:1787832975.646413:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:1.0:1787832975.646425:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+10:14438:x1874678283095680:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832975.646458:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832975.646486:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b814e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c05 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646603:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646618:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646631:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832975.646726:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787832975.646730:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832975.646757:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646789:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b814e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646810:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.646819:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:1.0:1787832975.646823:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787832975.646826:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41600, rc 0) 00000100:00100000:1.0:1787832975.647100:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ff6567d-af40-4908-85d0-cd5fc99f89cd+11:14438:x1874678283095680:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 486us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.647118:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 26 00000100:00100000:0.0:1787832975.653089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.653217:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283095808 00000100:00100000:1.0:1787832975.653229:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283095808 00000100:00100000:1.0:1787832975.653291:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:1.0:1787832975.653301:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+11:14438:x1874678283095808:12345-192.168.201.34@tcp:37:lfs.0 00000100:00100000:1.0:1787832975.658661:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+11:14438:x1874678283095808:12345-192.168.201.34@tcp:37:lfs.0 Request processed in 5346us (5570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.658679:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 3 00000100:00100000:0.0:1787832975.665927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.666025:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096064 00000100:00100000:3.0:1787832975.666038:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096064 00000100:00100000:3.0:1787832975.666113:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:3.0:1787832975.666122:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355eda8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+11:14438:x1874678283096064:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832975.666494:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355eda8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+12:14438:x1874678283096064:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 371us (590us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787832975.666503:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 4 00000100:00100000:1.0:1787832975.699102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832975.699159:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096192 00000100:00100000:0.0:1787832975.699169:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096192 00000100:00100000:0.0:1787832975.699236:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:0.0:1787832975.699248:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+10:14444:x1874678283096192:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832975.699299:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832975.699321:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00400/0x72bd9178b14b815c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c0c expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699397:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699409:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699419:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699430:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699434:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699438:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699567:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00200/0x72bd9178b14b8171 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699572:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00200/0x72bd9178b14b8171 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699577:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00200/0x72bd9178b14b8171 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787832975.699608:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787832975.699615:0:16067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787832975.699660:0:16067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00200/0x72bd9178b14b8171 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699673:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699677:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699682:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699687:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a01400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832975.699692:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699826:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699840:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:0.0:1787832975.699842:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832975.699856:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699864:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01400/0x72bd9178b14b8163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699881:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699888:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699908:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699914:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832975.699917:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699923:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699931:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3550109600) 00010000:00010000:0.0:1787832975.699933:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787832975.699936:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699951:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b816a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.699992:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00400/0x72bd9178b14b815c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c0c expref: 12 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.700006:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00200/0x72bd9178b14b8171 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c0c expref: 11 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.700012:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:0.0:1787832975.700013:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787832975.700015:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a00200, rc 0) 00000100:00100000:0.0:1787832975.700095:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+11:14444:x1874678283096192:12345-192.168.201.34@tcp:101:bash.0 Request processed in 849us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.700112:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 27 00000100:00100000:1.0:1787832975.702075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832975.702153:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096448 00000100:00100000:0.0:1787832975.702165:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096448 00000100:00100000:0.0:1787832975.702225:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 28 00000100:00100000:0.0:1787832975.702235:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+11:14444:x1874678283096448:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832975.702262:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832975.702284:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b8178 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c13 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.702421:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.702434:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.702441:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.702470:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.702490:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 11 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.702500:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1874678300909184:192.168.201.34@tcp:104: 00000100:00100000:0.0:1787832975.702588:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3573924000 going to sleep for 11 seconds 00000100:00100000:0.0:1787832975.703916:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c35465dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1874678300909184:192.168.201.34@tcp:104: 00010000:00010000:0.0:1787832975.703971:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832975.704565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832975.704637:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096576 00000100:00100000:0.0:1787832975.704643:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096576 00010000:00010000:0.0:1787832975.704681:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 12 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.704871:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787832975.704882:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+12:2353:x1874678283096576:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787832975.704904:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787832975.704914:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 12 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.704927:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 12 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.704964:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8155 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c05 expref: 12 pid: 14436 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.704984:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:0.0:1787832975.704989:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.704999:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.705007:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.705054:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787832975.705112:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+11:2353:x1874678283096576:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 232us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.705121:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00010000:00010000:2.0:1787832975.705289:0:14436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.705299:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.705328:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.705339:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.705348:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.708964:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709012:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709055:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832975.709080:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787832975.709137:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709145:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709153:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709159:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a01800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.709164:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709173:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709189:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:2.0:1787832975.709275:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.709282:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709289:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a01800/0x72bd9178b14b817f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787832975.709306:0:14436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d230696 reply state 0000000002089e06 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832975.709322:0:14436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787832975.709375:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b8178 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709392:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.709400:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832975.709403:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787832975.709405:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610a800, rc 0) 00000100:00100000:2.0:1787832975.710237:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+14:14444:x1874678283096448:12345-192.168.201.34@tcp:101:bash.0 Request processed in 7996us (8167us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787832975.710251:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 28 00010000:00010000:2.0:1787832975.714084:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714103:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714111:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714117:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832975.714122:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714131:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714174:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c3547ea9b00) 00010000:00010000:2.0:1787832975.714177:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832975.714184:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.714191:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b8186 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832975.722429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.722727:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096704 00000100:00100000:3.0:1787832975.722740:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096704 00000100:00100000:3.0:1787832975.722806:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:3.0:1787832975.722819:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+13:14444:x1874678283096704:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832975.722882:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832975.722915:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b819b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c1a expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723000:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723016:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723027:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832975.723078:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787832975.723084:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832975.723112:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723124:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723153:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b819b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c1a expref: 15 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723174:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c1a expref: 14 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832975.723183:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832975.723186:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832975.723190:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832975.723274:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+14:14444:x1874678283096704:12345-192.168.201.34@tcp:101:bash.0 Request processed in 459us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832975.723282:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:1.0:1787832975.726017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.726253:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283096960 00000100:00100000:3.0:1787832975.726265:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283096960 00000100:00100000:3.0:1787832975.726331:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:3.0:1787832975.726342:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+14:14444:x1874678283096960:12345-192.168.201.34@tcp:35:bash.0 00000100:00100000:3.0:1787832975.726858:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+15:14444:x1874678283096960:12345-192.168.201.34@tcp:35:bash.0 Request processed in 505us (843us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787832975.726867:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 5 00000100:00100000:1.0:1787832975.823597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832975.825025:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283097216 00000100:00100000:2.0:1787832975.825039:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283097216 00000100:00100000:2.0:1787832975.825191:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832975.825203:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+15:14454:x1874678283097216:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832975.825235:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832975.825271:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c21 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832975.825418:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787832975.825583:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c21 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.825599:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:2.0:1787832975.825602:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832975.825609:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c21 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.825628:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610b200, rc 0) 00000100:00100000:2.0:1787832975.825813:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+16:14454:x1874678283097216:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 613us (2234us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787832975.825839:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832975.829270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.829383:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283097472 00000100:00100000:1.0:1787832975.829394:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283097472 00000100:00100000:1.0:1787832975.829508:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1787832975.829520:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+16:14454:x1874678283097472:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:1.0:1787832975.832858:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+17:14454:x1874678283097472:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 3315us (3575us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787832975.832876:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 6 00000100:00100000:1.0:1787832975.880212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.884609:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283097728 00000100:00100000:3.0:1787832975.885079:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283097728 00000100:00100000:2.0:1787832975.885331:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:2.0:1787832975.885345:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+17:14457:x1874678283097728:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:2.0:1787832975.885379:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832975.885406:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c28 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.885539:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b81be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.885557:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b81be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.885570:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b81be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832975.885584:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787832975.885807:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c28 expref: 20 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.885832:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b81be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c28 expref: 19 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832975.885856:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832975.885860:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787832975.885864:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610b600, rc 0) 00000100:00100000:2.0:1787832975.886086:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+19:14457:x1874678283097728:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 743us (5886us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787832975.886114:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 31 00000100:00100000:1.0:1787832975.888379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.889771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832975.889795:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283097984 00000100:00100000:0.0:1787832975.889817:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283097856 00000100:00100000:1.0:1787832975.889821:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283097984 00000100:00100000:0.0:1787832975.889825:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283097856 00000100:00100000:1.0:1787832975.889922:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:1.0:1787832975.889935:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5446e631-f40d-43fa-8297-9fb53157ce22+20:2352:x1874678283097984:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832975.889954:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832975.889986:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b600/0x72bd9178b14b81be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c28 expref: 20 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832975.890014:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:1.0:1787832975.890021:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832975.890097:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5446e631-f40d-43fa-8297-9fb53157ce22+19:2352:x1874678283097984:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832975.890107:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832975.890153:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:0.0:1787832975.890164:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356579c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+18:14457:x1874678283097856:12345-192.168.201.34@tcp:54:lfs.0 00010000:00010000:0.0:1787832975.890241:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890258:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890271:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890306:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890313:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890321:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890328:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3443a00a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787832975.890333:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890355:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890366:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:0.0:1787832975.890369:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787832975.890373:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832975.890379:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b81cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832975.890432:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356579c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+18:14457:x1874678283097856:12345-192.168.201.34@tcp:54:lfs.0 Request processed in 270us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832975.890441:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 32 00000100:00100000:1.0:1787832975.892968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832975.893072:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283098240 00000100:00100000:3.0:1787832975.893083:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283098240 00000100:00100000:3.0:1787832975.893148:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 7 00000100:00100000:3.0:1787832975.893160:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+18:14457:x1874678283098240:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832975.893453:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+19:14457:x1874678283098240:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 295us (499us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787832975.893460:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 7 00010000:00010000:2.0:1787832976.139929:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832976.257912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832976.258234:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283098496 00000100:00100000:3.0:1787832976.258247:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283098496 00000100:00100000:3.0:1787832976.258542:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:3.0:1787832976.258555:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+19:14488:x1874678283098496:12345-192.168.201.34@tcp:101:cat.0 00010000:00010000:3.0:1787832976.258589:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832976.258614:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b81d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c2f expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832976.258871:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b81da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832976.258889:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b81da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832976.258903:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b81da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832976.258917:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787832976.259571:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b81d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c2f expref: 22 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832976.259596:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b81da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c2f expref: 21 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832976.259605:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832976.259609:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832976.259612:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86a00, rc 0) 00000100:00100000:3.0:1787832976.259854:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+21:14488:x1874678283098496:12345-192.168.201.34@tcp:101:cat.0 Request processed in 1301us (1959us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787832976.259864:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 33 00000100:00100000:0.0:1787832976.268400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832976.268581:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283098880 00000100:00100000:2.0:1787832976.268593:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283098880 00000100:00100000:2.0:1787832976.268676:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:2.0:1787832976.268688:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+21:2355:x1874678283098880:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832976.268753:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832976.268785:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b81da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c2f expref: 21 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.268811:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832976.268817:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832976.268907:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+20:2355:x1874678283098880:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 221us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832976.268915:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 1 00000100:00100000:1.0:1787832976.270245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832976.270539:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283098752 00000100:00100000:2.0:1787832976.270560:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283098752 00000100:00100000:2.0:1787832976.270618:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:2.0:1787832976.270629:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+20:14488:x1874678283098752:12345-192.168.201.34@tcp:35:cat.0 00000100:00100000:2.0:1787832976.271095:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+21:14488:x1874678283098752:12345-192.168.201.34@tcp:35:cat.0 Request processed in 466us (855us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787832976.271105:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 8 00000100:00100000:0.0:1787832976.398822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832976.399077:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283099136 00000100:00100000:1.0:1787832976.399089:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283099136 00000100:00100000:1.0:1787832976.399166:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:1.0:1787832976.399178:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+21:14494:x1874678283099136:12345-192.168.201.34@tcp:101:dd.0 00010000:00010000:1.0:1787832976.399212:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832976.399237:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b81e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c36 expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832976.399382:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b81ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832976.399398:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b81ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832976.399431:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b81ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832976.399444:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787832976.399629:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b81e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c36 expref: 24 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832976.399651:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b81ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c36 expref: 23 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832976.399660:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:1.0:1787832976.399663:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832976.399666:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40800, rc 0) 00000100:00100000:1.0:1787832976.399826:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35465dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+23:14494:x1874678283099136:12345-192.168.201.34@tcp:101:dd.0 Request processed in 650us (1016us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787832976.399842:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 34 00000100:00100000:0.0:1787832976.407535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832976.407644:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283099392 00000100:00100000:2.0:1787832976.407655:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283099392 00000100:00100000:2.0:1787832976.408088:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 35 00000100:00100000:2.0:1787832976.408101:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+23:14494:x1874678283099392:12345-192.168.201.34@tcp:36:dd.0 00010000:00010000:2.0:1787832976.408189:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787832976.408221:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b81ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c36 expref: 23 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.408246:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b81a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c1a expref: 22 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.408259:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832976.408264:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787832976.409660:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.409682:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.409693:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832976.410202:0:14434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787832976.410249:0:14434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e33904d reply state 00000000ac0cb673 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832976.410261:0:14434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787832976.410608:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+24:14494:x1874678283099392:12345-192.168.201.34@tcp:36:dd.0 Request processed in 2507us (3181us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787832976.410618:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 35 00000020:00080000:2.0:1787832976.410625:0:14434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787832976.436079:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436139:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436148:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436156:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610b200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832976.436162:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436171:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436193:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832976.436196:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832976.436202:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832976.436209:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610b200/0x72bd9178b14b81fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832976.628507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832976.631221:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283099648 00000100:00100000:1.0:1787832976.631239:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283099648 00000100:00100000:1.0:1787832976.631344:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:1.0:1787832976.631356:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+23:14494:x1874678283099648:12345-192.168.201.34@tcp:35:dd.0 00000100:00100000:1.0:1787832976.631771:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+24:14494:x1874678283099648:12345-192.168.201.34@tcp:35:dd.0 Request processed in 417us (3280us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787832976.631780:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 9 00000100:00100000:0.0:1787832977.004231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832977.004385:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283099776 00000100:00100000:1.0:1787832977.004397:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283099776 00000100:00100000:1.0:1787832977.004501:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 36 00000100:00100000:1.0:1787832977.004513:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+24:14509:x1874678283099776:12345-192.168.201.34@tcp:101:stat.0 00000100:00080000:2.0:1787832977.004542:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787832977.004565:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832977.004593:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8204 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c3d expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004693:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004749:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004765:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004782:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004789:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004796:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004938:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004947:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.004955:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832977.005888:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787832977.005911:0:16067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832977.007112:0:16067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007139:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007151:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007157:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007166:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007172:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832977.007177:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007185:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007201:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:1.0:1787832977.007204:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832977.007209:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007216:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b820b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007235:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007257:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.007263:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009128:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832977.009138:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009148:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009165:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c3559189a00) 00010000:00010000:1.0:1787832977.009168:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832977.009172:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009180:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8212 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009257:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8204 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c3d expref: 26 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009273:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c3d expref: 25 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.009281:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:1.0:1787832977.009283:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832977.009308:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40000, rc 0) 00000100:00100000:1.0:1787832977.009405:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+25:14509:x1874678283099776:12345-192.168.201.34@tcp:101:stat.0 Request processed in 4893us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832977.009416:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 36 00010000:00010000:1.0:1787832977.164943:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787832977.168930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832977.169132:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283100032 00000100:00100000:3.0:1787832977.169143:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283100032 00000100:00100000:3.0:1787832977.169213:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 37 00000100:00100000:3.0:1787832977.169225:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+25:14515:x1874678283100032:12345-192.168.201.34@tcp:36:truncate.0 00010000:00010000:3.0:1787832977.169283:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832977.169327:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8219 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c3d expref: 25 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.169346:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832977.169352:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832977.169588:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.169606:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.169618:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832977.169672:0:14436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787832977.169698:0:14436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fcf53ba reply state 0000000093cfb9ce transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832977.169760:0:14436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832977.169898:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+27:14515:x1874678283100032:12345-192.168.201.34@tcp:36:truncate.0 Request processed in 674us (977us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787832977.169906:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 37 00000020:00080000:3.0:1787832977.169912:0:14436:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787832977.175732:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175750:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175759:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175765:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832977.175786:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175795:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175816:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832977.175830:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832977.175835:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.175843:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8220 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787832977.550290:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787832977.558322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832977.558511:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283100160 00000100:00100000:3.0:1787832977.558522:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283100160 00000100:00100000:1.0:1787832977.560223:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:1.0:1787832977.560246:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+26:14529:x1874678283100160:12345-192.168.201.34@tcp:101:stat.0 00010000:00010000:1.0:1787832977.560275:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832977.560301:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8227 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c44 expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560374:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560391:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560405:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560419:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560427:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560433:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560543:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560564:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560572:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832977.560608:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787832977.560613:0:16067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832977.560643:0:16067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560656:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560666:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560673:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.560680:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561173:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832977.561179:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561187:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561203:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:1.0:1787832977.561214:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832977.561220:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561227:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40400/0x72bd9178b14b822e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561242:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561249:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561255:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561261:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832977.561264:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561270:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561278:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c3559189a00) 00010000:00010000:1.0:1787832977.561281:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832977.561283:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561289:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8235 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561325:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b8227 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 28 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561351:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 27 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.561359:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:1.0:1787832977.561362:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787832977.561364:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832977.561442:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+27:14529:x1874678283100160:12345-192.168.201.34@tcp:101:stat.0 Request processed in 1206us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832977.561451:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 38 00000100:00100000:2.0:1787832977.676000:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300909312:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.676057:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832977.676082:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300909440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787832977.676123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832977.676249:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909312 00000100:00100000:0.0:1787832977.676259:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909312 00000100:00100000:0.0:1787832977.676316:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787832977.676331:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3306:x1874678300909312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.676400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300909696:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.676412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832977.676478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832977.676494:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300909568:0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.676531:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787832977.676539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832977.676546:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300909824:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.676577:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300910080:0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.676596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832977.676691:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909824 00000100:00100000:3.0:1787832977.676698:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909824 00000100:00100000:3.0:1787832977.676795:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832977.676805:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300909824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.676899:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874678300909824:12345-0@lo:400:kworker.0 Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832977.676907:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787832977.676952:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874678300909824:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.676962:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909440 00000100:00100000:1.0:1787832977.676970:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909440 00000100:00100000:1.0:1787832977.677030:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787832977.677039:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300909440:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832977.677055:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909696 00000100:00100000:3.0:1787832977.677061:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909696 00002000:00000024:1.0:1787832977.677068:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832977.677099:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909568 00000100:00100000:3.0:1787832977.677105:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909568 00000100:00100000:1.0:1787832977.677130:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874678300909440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832977.677144:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787832977.677145:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787832977.677161:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874678300909696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787832977.677183:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787832977.677205:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832977.677246:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874678300909696:12345-0@lo:400:kworker.0 Request processed in 81us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832977.677247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832977.677262:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787832977.677287:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787832977.677297:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300909568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.677318:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300909440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832977.677349:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874678300909568:12345-0@lo:400:kworker.0 Request processed in 51us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832977.677358:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787832977.677365:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874678300909568:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.677380:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787832977.677390:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357bb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300909952:0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.677425:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300909696:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.677437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832977.677497:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300910080 00000100:00100000:3.0:1787832977.677504:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300910080 00000100:00080000:3.0:1787832977.677531:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832977.677562:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300909952 00000100:00100000:3.0:1787832977.677573:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300909952 00000100:00100000:1.0:1787832977.677580:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787832977.677594:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832977.677595:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300910080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832977.677628:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787832977.677638:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.677649:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874678300910080:12345-0@lo:400:kworker.0 Request processed in 58us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832977.677657:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787832977.677698:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874678300909952:12345-0@lo:400:kworker.0 Request processed in 60us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832977.677743:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787832977.677743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874678300909952:0@lo:400:kworker.0 00000100:00100000:1.0:1787832977.677767:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874678300910080:0@lo:400:kworker.0 00000100:00100000:0.0:1787832977.679056:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3306:x1874678300909312:12345-0@lo:400:kworker.0 Request processed in 2724us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832977.679071:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787832977.679078:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357bb77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ea647735-d55a-4124-bae8-f7db9715e04e:3306:1874678300909312:0@lo:400:kworker.0 00000100:00100000:0.0:1787832977.764900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832977.765198:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283100416 00000100:00100000:3.0:1787832977.765210:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283100416 00000100:00100000:3.0:1787832977.765279:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:3.0:1787832977.765289:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+27:14539:x1874678283100416:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:3.0:1787832977.765314:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832977.765337:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c4b expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832977.765468:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787832977.765586:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8243 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c4b expref: 29 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.765604:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:3.0:1787832977.765607:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787832977.765613:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c4b expref: 29 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.765627:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86200, rc 0) 00000100:00100000:3.0:1787832977.765759:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+28:14539:x1874678283100416:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 471us (867us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787832977.765780:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 39 00000100:00100000:0.0:1787832977.771587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832977.771731:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283100672 00000100:00100000:2.0:1787832977.771744:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283100672 00000100:00100000:2.0:1787832977.771818:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:2.0:1787832977.771830:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c355edaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+28:14539:x1874678283100672:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:2.0:1787832977.772125:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c355edaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+29:14539:x1874678283100672:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 295us (558us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787832977.772133:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 10 00000100:00100000:0.0:1787832977.929033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832977.931017:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283100928 00000100:00100000:3.0:1787832977.931032:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283100928 00000100:00100000:3.0:1787832977.931110:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:3.0:1787832977.931120:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+29:14545:x1874678283100928:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832977.931147:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832977.931171:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8251 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c52 expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931270:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931286:0:16067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931295:0:16067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 30 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931304:0:16067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931342:0:16067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 30 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931357:0:16067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 30 pid: 16067 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832977.931372:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543273c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300910208:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832977.931507:0:16067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.931517:0:16067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832977.931526:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300910336:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832977.931547:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3542b60f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787832977.947778:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543273c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300910208:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832977.947794:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300910336:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832977.947837:0:16067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832977.965788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832977.965837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832977.965931:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101056 00000100:00100000:2.0:1787832977.965941:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101056 00010000:00010000:2.0:1787832977.965990:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 31 pid: 16067 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832977.966039:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101184 00000100:00100000:2.0:1787832977.966055:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101184 00010000:00010000:2.0:1787832977.966072:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 32 pid: 14436 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832977.966096:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832977.966106:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3566708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+32:2353:x1874678283101056:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832977.966123:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832977.966130:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 32 pid: 16067 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966144:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 32 pid: 16067 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966168:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b823c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c44 expref: 32 pid: 16067 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966183:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832977.966189:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966198:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966206:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832977.966257:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3566708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+31:2353:x1874678283101056:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 152us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832977.966264:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:2.0:1787832977.966308:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:2.0:1787832977.966322:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+30:2354:x1874678283101184:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832977.966329:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832977.966334:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966344:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966356:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a800/0x72bd9178b14b818d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c13 expref: 30 pid: 14436 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966367:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832977.966370:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966378:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966386:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966410:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832977.966427:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+29:2354:x1874678283101184:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 106us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832977.966433:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00010000:00010000:2.0:1787832977.966527:0:16067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966535:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832977.966561:0:16067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787832977.966749:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8251 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 30 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966764:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 29 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.966771:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832977.966773:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787832977.966776:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:2.0:1787832977.966816:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+29:14545:x1874678283100928:12345-192.168.201.34@tcp:101:bash.0 Request processed in 35685us (37781us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1787832977.966824:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 40 00000100:00100000:0.0:1787832977.979918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832977.980576:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101440 00000100:00100000:3.0:1787832977.980589:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101440 00000100:00100000:3.0:1787832977.980653:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 41 00000100:00100000:3.0:1787832977.980664:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+29:14545:x1874678283101440:12345-192.168.201.34@tcp:36:bash.0 00010000:00010000:3.0:1787832977.981318:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.981339:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832977.981353:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787832977.981400:0:14434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1787832977.981661:0:14434:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab9874ad reply state 00000000eaec1e00 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832977.981683:0:14434:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832977.982324:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+32:14545:x1874678283101440:12345-192.168.201.34@tcp:36:bash.0 Request processed in 1658us (2410us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1787832977.982334:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 41 00000020:00080000:3.0:1787832977.982339:0:14434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787832977.986305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832977.986394:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101568 00000100:00100000:1.0:1787832977.986405:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101568 00000100:00100000:1.0:1787832977.986470:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 42 00000100:00100000:1.0:1787832977.986480:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+32:14545:x1874678283101568:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:1.0:1787832977.986503:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832977.986526:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b826d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c59 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.986601:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b826d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c59 expref: 33 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.986638:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b826d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c59 expref: 33 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832977.986660:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:1.0:1787832977.986663:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832977.986667:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41800, rc 0) 00000100:00100000:1.0:1787832977.986748:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+33:14545:x1874678283101568:12345-192.168.201.34@tcp:101:bash.0 Request processed in 269us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832977.986756:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 42 00010000:00010000:2.0:1787832977.987525:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987536:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987543:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987550:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832977.987554:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987562:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987604:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832977.987606:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832977.987611:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832977.987618:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8266 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.029950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.030165:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101696 00000100:00100000:3.0:1787832978.030175:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101696 00000100:00100000:3.0:1787832978.030240:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:3.0:1787832978.030251:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+32:14545:x1874678283101696:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832978.030273:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832978.030298:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8274 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c60 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.030382:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.030398:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 33 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.030408:0:14435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.030456:0:14435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 33 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.030470:0:14435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 33 pid: 16067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.030502:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1874678300910464:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832978.030605:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35464f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787832978.041799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.041990:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283101824 00000100:00100000:2.0:1787832978.042001:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283101824 00010000:00010000:2.0:1787832978.042053:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 34 pid: 16067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.042099:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832978.042109:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+34:2352:x1874678283101824:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832978.042127:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832978.042134:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 34 pid: 16067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.042147:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 34 pid: 16067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.042175:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832978.042181:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.042190:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.042212:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.042232:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832978.042289:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+34:2352:x1874678283101824:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 181us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.042297:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00010000:00010000:3.0:1787832978.042961:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8258 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c52 expref: 33 pid: 16067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.042981:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1874678300910464:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832978.043010:0:14435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.043020:0:14435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.043027:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832978.043071:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787832978.043075:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832978.043093:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.043124:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8274 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c60 expref: 33 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.043138:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c60 expref: 32 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.043147:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:3.0:1787832978.043159:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787832978.043162:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86200, rc 0) 00000100:00100000:3.0:1787832978.043291:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+32:14545:x1874678283101696:12345-192.168.201.34@tcp:101:bash.0 Request processed in 13041us (13357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.043299:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 43 00000100:00100000:0.0:1787832978.052431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.052510:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102080 00000100:00100000:2.0:1787832978.052519:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102080 00000100:00100000:2.0:1787832978.052596:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:2.0:1787832978.052606:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+32:14545:x1874678283102080:12345-192.168.201.34@tcp:103:bash.0 00010000:00010000:2.0:1787832978.052624:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787832978.052652:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b827b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c60 expref: 32 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.052675:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41800/0x72bd9178b14b826d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c59 expref: 31 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.052687:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3547ea9c00) 00010000:00010000:2.0:1787832978.052698:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832978.052771:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+30:14545:x1874678283102080:12345-192.168.201.34@tcp:103:bash.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.052779:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 2 00000100:00100000:1.0:1787832978.057267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.057387:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102208 00000100:00100000:3.0:1787832978.057397:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102208 00000100:00100000:3.0:1787832978.057455:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:3.0:1787832978.057465:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+30:14545:x1874678283102208:12345-192.168.201.34@tcp:58:bash.0 00010000:00010000:3.0:1787832978.057566:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.057597:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.057609:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787832978.060379:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787832978.060526:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787832978.060612:0:14436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787832978.060894:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+30:14545:x1874678283102208:12345-192.168.201.34@tcp:58:bash.0 Request processed in 3423us (3629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.060918:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 44 00000100:00100000:0.0:1787832978.064397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.064472:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102336 00000100:00100000:3.0:1787832978.064482:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102336 00000100:00100000:3.0:1787832978.064538:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 45 00000100:00100000:3.0:1787832978.064548:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+30:14545:x1874678283102336:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:3.0:1787832978.064581:0:14434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832978.064604:0:14434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c67 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064667:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064694:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 31 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064733:0:14434:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064747:0:14434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 31 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064761:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832978.064765:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787832978.064768:0:14434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 31 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.064776:0:14434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356bc86000, rc 0) 00000100:00100000:3.0:1787832978.064844:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+31:14545:x1874678283102336:12345-192.168.201.34@tcp:101:bash.0 Request processed in 297us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.064852:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 45 00010000:00010000:0.0:1787832978.189482:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787832978.308005:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:3.0:1787832978.308029:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1787832978.308044:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:3.0:1787832978.308061:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1787832978.308067:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:3.0:1787832978.308098:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1787832978.572254:0:14468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787832978.572264:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787832978.572308:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787832978.572317:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787832978.572445:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14468:1874678300910592:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832978.572550:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c34418943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787832978.586615:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14468:1874678300910592:192.168.201.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787832978.596375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.596478:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102464 00000100:00100000:2.0:1787832978.596488:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102464 00000100:00100000:2.0:1787832978.596545:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:2.0:1787832978.596556:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102464:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787832978.596640:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102464:12345-192.168.201.34@tcp:900:lhsmtool_posix.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.596649:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832978.602644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.602739:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102592 00000100:00100000:2.0:1787832978.602751:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102592 00000100:00100000:2.0:1787832978.602822:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:2.0:1787832978.602833:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102592:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787832978.602989:0:16067:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787832978.603334:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102592:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 502us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.603343:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 46 00000100:00100000:0.0:1787832978.627508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.627781:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102720 00000100:00100000:3.0:1787832978.627803:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102720 00000100:00100000:3.0:1787832978.627878:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:3.0:1787832978.627888:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102720:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787832978.627983:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628013:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628025:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628091:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628099:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628106:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628127:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628135:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628141:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787832978.628179:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787832978.628183:0:14434:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787832978.628198:0:14434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628208:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628220:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628227:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628233:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832978.628238:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628247:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628260:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3559189800) 00010000:00010000:3.0:1787832978.628263:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832978.628267:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628273:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86200/0x72bd9178b14b8290 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628287:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628294:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628300:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628304:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832978.628311:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628318:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628325:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c3543a9cd00) 00010000:00010000:3.0:1787832978.628327:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832978.628330:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628336:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b8297 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628351:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628357:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628363:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628367:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832978.628370:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628377:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628383:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832978.628385:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832978.628392:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.628398:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b829e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.628472:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102720:12345-192.168.201.34@tcp:34:lhsmtool_posix.0 Request processed in 585us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.628480:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 47 00000100:00100000:1.0:1787832978.633058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.647163:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283102976 00000100:00100000:2.0:1787832978.647183:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283102976 00000100:00100000:2.0:1787832978.647258:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:2.0:1787832978.647269:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+10:14547:x1874678283102976:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832978.647291:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832978.647314:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b82a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c6e expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647430:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647460:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647473:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787832978.647484:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787832978.647602:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647610:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647618:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647624:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610ac00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832978.647629:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647636:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647650:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:2.0:1787832978.647653:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787832978.647659:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647677:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ac00/0x72bd9178b14b82ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647758:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b82a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c6e expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647770:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c3559189800) 00010000:00010000:2.0:1787832978.647772:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787832978.647776:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b82a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c6e expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.647787:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610aa00, rc 0) 00000100:00100000:2.0:1787832978.647866:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b5883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+11:14547:x1874678283102976:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 598us (14818us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787832978.647875:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 48 00000100:00100000:0.0:1787832978.653089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.653311:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283103104 00000100:00100000:1.0:1787832978.653322:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283103104 00000100:00100000:1.0:1787832978.653381:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:1.0:1787832978.653390:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+11:14547:x1874678283103104:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787832978.653427:0:14434:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787832978.653536:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+11:14547:x1874678283103104:12345-192.168.201.34@tcp:53:lhsmtool_posix.0 Request processed in 146us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.653559:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 49 00000100:00100000:0.0:1787832978.661852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.662036:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283103360 00000100:00100000:2.0:1787832978.662046:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283103360 00000100:00100000:2.0:1787832978.662206:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:2.0:1787832978.662217:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+11:14547:x1874678283103360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832978.662238:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832978.662263:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b82ba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c75 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787832978.663747:0:14436:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787832978.663756:0:14436:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787832978.663815:0:14436:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787832978.664426:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b82c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.664444:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b82c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.664457:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b82c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.664515:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610aa00/0x72bd9178b14b82ba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c75 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.664548:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b82c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c75 expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.664558:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3550109b00) 00010000:00010000:0.0:1787832978.664561:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787832978.664565:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a00c00, rc 0) 00000100:00100000:0.0:1787832978.664643:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+13:14547:x1874678283103360:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 2428us (2799us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787832978.664653:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 50 00000100:00100000:0.0:1787832978.669645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.669846:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283103616 00000100:00100000:1.0:1787832978.670200:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283103616 00000100:00100000:1.0:1787832978.670260:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:1.0:1787832978.670271:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+13:14547:x1874678283103616:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787832978.670327:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832978.670356:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00c00/0x72bd9178b14b82c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c75 expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670375:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3550109b00) 00010000:00010000:1.0:1787832978.670387:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787832978.670411:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670426:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670436:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670486:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670494:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.670501:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671239:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671249:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671255:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671262:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.671267:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671276:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671287:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:1.0:1787832978.671290:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832978.671293:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671299:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b82cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671309:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671315:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671321:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671332:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.671335:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671341:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671348:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd5f12489 (ffff8c3559189d00) 00010000:00010000:1.0:1787832978.671351:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832978.671354:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.671360:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd5f12489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.671485:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35464fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+12:14547:x1874678283103616:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1213us (1847us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787832978.671495:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 51 00000100:00100000:2.0:1787832978.678207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.678303:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283103744 00000100:00100000:3.0:1787832978.678313:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283103744 00000100:00100000:3.0:1787832978.678414:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:3.0:1787832978.678424:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+12:14547:x1874678283103744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832978.678447:0:16067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832978.678472:0:16067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b82dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c7c expref: -99 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678508:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b82e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678522:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b82e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678534:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b82e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678630:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031000/0x72bd9178b14b82dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c7c expref: 14 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678649:0:16067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030800/0x72bd9178b14b82e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c7c expref: 13 pid: 16067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.678664:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:3.0:1787832978.678667:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787832978.678671:0:16067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540030800, rc 0) 00000100:00100000:2.0:1787832978.679431:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+13:14547:x1874678283103744:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 1005us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.679458:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 52 00000100:00100000:0.0:1787832978.685384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.685544:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104000 00000100:00100000:3.0:1787832978.685556:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104000 00000100:00100000:3.0:1787832978.685624:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:3.0:1787832978.685636:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+13:14547:x1874678283104000:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832978.685761:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.685783:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.685807:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787832978.686632:0:14435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787832978.686643:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 501714940387ns, next at 502714937969ns, rc = 0 00000004:00010000:3.0:1787832978.687469:0:14435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000724c391 reply state 00000000a2da0745 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.687482:0:14435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832978.687589:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+15:14547:x1874678283104000:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 1954us (2214us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787832978.687598:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 53 00000100:00100000:1.0:1787832978.696606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832978.696735:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104128 00000100:00100000:0.0:1787832978.696746:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104128 00000100:00100000:0.0:1787832978.696809:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 54 00000100:00100000:0.0:1787832978.696820:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+15:14547:x1874678283104128:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787832978.696844:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832978.696866:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c83 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.696927:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.696943:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.696982:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:0.0:1787832978.696985:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787832978.696989:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a00a00, rc 0) 00000100:00100000:0.0:1787832978.697046:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+16:14547:x1874678283104128:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 228us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832978.697053:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 54 00010000:00010000:2.0:1787832978.707850:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707881:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707889:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707896:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832978.707901:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707909:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707930:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:2.0:1787832978.707933:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787832978.707938:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.707944:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031400/0x72bd9178b14b82eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787832978.711444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.711575:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104256 00000100:00100000:3.0:1787832978.711586:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104256 00000100:00100000:3.0:1787832978.711685:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787832978.711698:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+5:2353:x1874678283104256:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787832978.712583:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+6:2353:x1874678283104256:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 886us (1145us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787832978.712594:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00080000:0.0:1787832978.713616:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787832978.731462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.732386:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104512 00000100:00100000:3.0:1787832978.732411:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104512 00000100:00100000:3.0:1787832978.732488:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:3.0:1787832978.732501:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+15:14547:x1874678283104512:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787832978.732811:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+16:14547:x1874678283104512:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 311us (1357us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787832978.732820:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 11 00000100:00100000:0.0:1787832978.744841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.745896:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104768 00000100:00100000:3.0:1787832978.745909:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104768 00000100:00100000:3.0:1787832978.745982:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:3.0:1787832978.746003:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+16:14547:x1874678283104768:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787832978.746599:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+16:14547:x1874678283104768:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 606us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.746609:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 55 00000100:00100000:0.0:1787832978.754305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.754473:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283104896 00000100:00100000:1.0:1787832978.754484:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283104896 00000100:00100000:1.0:1787832978.754570:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:1.0:1787832978.754581:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+16:14547:x1874678283104896:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787832978.754603:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832978.754625:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c8a expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754695:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754751:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754765:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832978.754812:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787832978.754831:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754873:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b82f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c8a expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754890:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c8a expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.754898:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:1.0:1787832978.754901:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787832978.754905:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad40800, rc 0) 00000100:00100000:1.0:1787832978.754958:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283104896:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 379us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.754966:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 56 00000100:00100000:0.0:1787832978.758770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.758963:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105024 00000100:00100000:3.0:1787832978.758974:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105024 00000100:00100000:2.0:1787832978.759362:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:2.0:1787832978.759373:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5446e631-f40d-43fa-8297-9fb53157ce22+6:2353:x1874678283105024:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787832978.759391:0:15117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787832978.759483:0:15117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c91 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787832978.759526:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902a93, blocks: 0x1 00010000:00010000:2.0:1787832978.759548:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1787832978.759553:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832978.759562:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.759584:0:15117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.759598:0:15117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c356610ae00, rc 0) 00000100:00100000:2.0:1787832978.759662:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5446e631-f40d-43fa-8297-9fb53157ce22+7:2353:x1874678283105024:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 291us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.759670:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:0.0:1787832978.766607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.767193:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105280 00000100:00100000:2.0:1787832978.767205:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105280 00000100:00100000:2.0:1787832978.767308:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:2.0:1787832978.767319:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283105280:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787832978.767452:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283105280:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 135us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.767460:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 57 00000100:00100000:0.0:1787832978.775578:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.777022:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105408 00000100:00100000:3.0:1787832978.777472:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105408 00000100:00100000:3.0:1787832978.777549:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:3.0:1787832978.777560:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283105408:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787832978.830758:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283105408:12345-192.168.201.34@tcp:44:lhsmtool_posix.0 Request processed in 53189us (55180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.830773:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 58 00000100:00100000:0.0:1787832978.834666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.834894:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105536 00000100:00100000:1.0:1787832978.834907:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105536 00000100:00100000:1.0:1787832978.834971:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:1.0:1787832978.834981:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:2352:x1874678283105536:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787832978.835439:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:2352:x1874678283105536:12345-192.168.201.34@tcp:16:lhsmtool_posix.0 Request processed in 458us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.835462:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832978.839372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.839555:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105792 00000100:00100000:3.0:1787832978.839566:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105792 00000100:00100000:3.0:1787832978.839629:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 59 00000100:00100000:3.0:1787832978.839640:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283105792:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787832978.839695:0:14435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787832978.839755:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40800/0x72bd9178b14b8300 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c8a expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.839774:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:3.0:1787832978.839780:0:14435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787832978.839819:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.839833:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.839845:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832978.841507:0:14435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef3dd4eb reply state 0000000083aab5d5 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.841523:0:14435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787832978.841682:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+18:14547:x1874678283105792:12345-192.168.201.34@tcp:36:lhsmtool_posix.0 Request processed in 2041us (2315us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787832978.841692:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 59 00000001:00080000:2.0:1787832978.842600:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1787832978.842634:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1787832978.842641:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787832978.843449:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787832978.843470:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300910720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787832978.843534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832978.843644:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300910720 00000100:00100000:1.0:1787832978.843653:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300910720 00000100:00100000:1.0:1787832978.843720:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787832978.843729:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300910720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787832978.845212:0:16068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787832978.845273:0:16068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787832978.845276:0:16068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787832978.845278:0:16068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787832979 -> 1787832979 00002000:00010000:1.0:1787832978.845281:0:16068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787832978.845361:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874678300910720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1632us (1825us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787832978.845372:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1787832978.845438:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c354b588f00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787832978.845444:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b588f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300910720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787832978.853523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.853588:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283105920 00000100:00100000:3.0:1787832978.853599:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283105920 00000100:00100000:3.0:1787832978.853662:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:3.0:1787832978.853686:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+7:14547:x1874678283105920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787832978.853731:0:15116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787832978.853753:0:15116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c98 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.853798:0:15116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.853807:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832978.853812:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787832978.853818:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.853867:0:15116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.853882:0:15116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.853897:0:15116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15116:1874678300910848:192.168.201.34@tcp:104: 00000100:00100000:3.0:1787832978.853967:0:15116:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c35603d7cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787832978.857811:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857828:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857836:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857842:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787832978.857847:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857867:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857888:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:2.0:1787832978.857891:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787832978.857896:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.857902:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031a00/0x72bd9178b14b830e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.861096:0:15116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543270780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15116:1874678300910848:192.168.201.34@tcp:104: 00010000:00010000:3.0:1787832978.861135:0:15116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832978.861176:0:15116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3540031000, rc 0) 00000100:00100000:3.0:1787832978.861234:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:14547:x1874678283105920:12345-192.168.201.34@tcp:101:lhsmtool_posix.0 Request processed in 7550us (7719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.861244:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:0.0:1787832978.870918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.871290:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106048 00000100:00100000:2.0:1787832978.871302:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106048 00010000:00010000:2.0:1787832978.871351:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.871411:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:2.0:1787832978.871421:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2352:x1874678283106048:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832978.871439:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832978.871462:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.871478:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.871503:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a79ac4/0x72bd9178b14b8307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c91 expref: 8 pid: 15117 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.871521:0:14419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832978.871526:0:14419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787832978.871533:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.871544:0:14419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.871585:0:14419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.871612:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14419:1874678300910976:192.168.201.34@tcp:105: 00000100:00100000:2.0:1787832978.871745:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c354305b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787832978.875900:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14419:1874678300910976:192.168.201.34@tcp:105: 00010000:00010000:2.0:1787832978.875936:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832978.875998:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5446e631-f40d-43fa-8297-9fb53157ce22+7:2352:x1874678283106048:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 4577us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.876009:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:0.0:1787832978.879975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.880266:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106176 00000100:00100000:1.0:1787832978.880278:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106176 00000100:00100000:1.0:1787832978.880339:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:1.0:1787832978.880349:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+7:2352:x1874678283106176:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787832978.880556:0:16068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787832978.880560:0:16068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787832978 00002000:00010000:1.0:1787832978.880562:0:16068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787832976 00002000:00010000:1.0:1787832978.880577:0:16068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787832979 -> 1787832978 00002000:00010000:1.0:1787832978.880579:0:16068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787832978.880643:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+8:2352:x1874678283106176:12345-192.168.201.34@tcp:2:lhsmtool_posix.0 Request processed in 295us (680us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787832978.880659:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 17 00000100:00100000:0.0:1787832978.896493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.896597:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106304 00000100:00100000:1.0:1787832978.896609:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106304 00000100:00100000:1.0:1787832978.896672:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:1.0:1787832978.896682:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+8:2353:x1874678283106304:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787832978.896761:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.896783:0:15119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.896803:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787832978.896808:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787832978.896813:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.896865:0:15119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.896880:0:15119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.896897:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15119:1874678300911104:192.168.201.34@tcp:104: 00000100:00100000:1.0:1787832978.896974:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894300 going to sleep for 11 seconds 00000100:00100000:0.0:1787832978.901875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.902021:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106432 00000100:00100000:2.0:1787832978.902041:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106432 00010000:00010000:2.0:1787832978.902083:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 9 pid: 15116 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.902124:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:2.0:1787832978.902134:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+9:2353:x1874678283106432:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787832978.902151:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787832978.902176:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 9 pid: 15116 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.902191:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 9 pid: 15116 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.902220:0:14420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832978.902226:0:14420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787832978.902246:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.902256:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.902278:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787832978.902334:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5446e631-f40d-43fa-8297-9fb53157ce22+9:2353:x1874678283106432:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 201us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832978.902342:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:1.0:1787832978.908194:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae7d802/0x72bd9178b14b8315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c98 expref: 8 pid: 15116 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.908238:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15119:1874678300911104:192.168.201.34@tcp:104: 00010000:00010000:1.0:1787832978.908265:0:15119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908278:0:15119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908285:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908330:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908338:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908348:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908355:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc160a420) 00010000:00010000:1.0:1787832978.908359:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908367:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908394:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.908402:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004eca0a1/0x72bd9178b14b831c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.908495:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5446e631-f40d-43fa-8297-9fb53157ce22+7:2353:x1874678283106304:12345-192.168.201.34@tcp:1:lhsmtool_posix.0 Request processed in 11814us (12013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.908505:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:0.0:1787832978.913668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832978.914465:0:16067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106688 00000100:00100000:2.0:1787832978.914476:0:16067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106688 00000100:00100000:2.0:1787832978.914577:0:16067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 60 00000100:00100000:2.0:1787832978.914588:0:16067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+13:14547:x1874678283106688:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787832978.914672:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915237:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915252:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915495:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915510:0:16067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915519:0:16067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915560:0:16067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.915576:0:16067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 14 pid: 14436 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.915592:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300911232:192.168.201.34@tcp:104: 00000100:00100000:2.0:1787832978.915697:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3544fc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787832978.925819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.925916:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106816 00000100:00100000:1.0:1787832978.925933:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106816 00010000:00010000:1.0:1787832978.925975:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 15 pid: 14436 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.926016:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 16 00000100:00100000:1.0:1787832978.926025:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5446e631-f40d-43fa-8297-9fb53157ce22+15:2353:x1874678283106816:12345-192.168.201.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787832978.926050:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787832978.926057:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 15 pid: 14436 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.926071:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 15 pid: 14436 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.926096:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:1.0:1787832978.926101:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.926118:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.926127:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.926148:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787832978.926195:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5446e631-f40d-43fa-8297-9fb53157ce22+15:2353:x1874678283106816:12345-192.168.201.34@tcp:103:ldlm_bl.0 Request processed in 171us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.926203:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 16 00010000:00010000:2.0:1787832978.926840:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3443a00a00/0x72bd9178b14b82f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c83 expref: 14 pid: 14436 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787832978.926873:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300911232:192.168.201.34@tcp:104: 00010000:00010000:2.0:1787832978.926897:0:16067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.926908:0:16067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787832978.926913:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787832978.927293:0:16067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787832978.927426:0:16067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787832978.927466:0:16067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787832978.927543:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16067:1874678300911360:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787832978.927634:0:16067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787832978.927661:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3544fc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787832978.928675:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300911360 00000100:00100000:1.0:1787832978.928682:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300911360 00000100:00100000:1.0:1787832978.928752:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787832978.928761:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16067:x1874678300911360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787832978.928874:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16067:x1874678300911360:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832978.928882:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787832978.930805:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c357b2ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16067:1874678300911360:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787832978.931777:0:16067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787832978.931885:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16067:1874678300911488:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787832978.932846:0:16067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832978.932984:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c355cd7a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787832978.935195:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300911488 00000100:00100000:1.0:1787832978.935208:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300911488 00000100:00100000:0.0:1787832978.942596:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787832978.942611:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16067:x1874678300911488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787832978.942912:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16067:x1874678300911488:12345-0@lo:1000:mdt00_003.0 Request processed in 304us (10068us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787832978.942921:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787832978.943063:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16067:1874678300911488:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787832978.943108:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943118:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943126:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943149:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610a200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.943154:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943163:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943181:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:1.0:1787832978.943184:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832978.943189:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943196:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610a200/0x72bd9178b14b832a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943237:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943243:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943249:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943254:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356bc86a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.943257:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943263:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943280:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:1.0:1787832978.943282:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787832978.943288:0:16067:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943300:0:16067:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943310:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.943345:0:16067:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86000/0x72bd9178b14b8289 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c67 expref: 17 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787832978.943359:0:16067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300911616:192.168.201.34@tcp:105: 00000100:00100000:1.0:1787832978.943435:0:16067:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3441894300 going to sleep for 11 seconds 00000100:00100000:0.0:1787832978.952433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.952550:0:16067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b589a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16067:1874678300911616:192.168.201.34@tcp:105: 00010000:00010000:1.0:1787832978.952581:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952592:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356bc86a00/0x72bd9178b14b8282 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952627:0:16067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952644:0:16067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952670:0:16067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952682:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952747:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952755:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952761:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad40000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.952766:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952773:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952795:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:1.0:1787832978.952799:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787832978.952804:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952809:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad40000/0x72bd9178b14b8331 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952819:0:16067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952825:0:16067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952836:0:16067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952841:0:16067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c356610ae00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787832978.952844:0:16067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952851:0:16067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952859:0:16067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:1.0:1787832978.952861:0:16067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787832978.952864:0:16067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.952869:0:16067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c356610ae00/0x72bd9178b14b8323 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832978.953372:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283106944 00000100:00100000:3.0:1787832978.953380:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283106944 00000100:00100000:3.0:1787832978.953427:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:3.0:1787832978.953437:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b7183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+18:14545:x1874678283106944:12345-192.168.201.34@tcp:49:bash.0 00000100:00100000:1.0:1787832978.953547:0:16067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3565f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5446e631-f40d-43fa-8297-9fb53157ce22+18:14547:x1874678283106688:12345-192.168.201.34@tcp:57:lhsmtool_posix.0 Request processed in 38960us (39890us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787832978.953557:0:16067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 60 00000020:00080000:1.0:1787832978.953562:0:16067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787832978.953846:0:14468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787832978.953851:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787832978.953886:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787832978.953891:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787832978.958360:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b7183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+17:14545:x1874678283106944:12345-192.168.201.34@tcp:49:bash.0 Request processed in 4911us (5924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832978.958375:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 12 00000100:00100000:0.0:1787832978.965313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832978.965393:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283107200 00000100:00100000:1.0:1787832978.965404:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283107200 00000100:00100000:1.0:1787832978.965460:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 13 00000100:00100000:1.0:1787832978.965470:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b7192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+17:14547:x1874678283107200:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787832978.966303:0:16306:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787832978.966395:0:16306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1787832978.966444:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966464:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966476:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966485:0:16306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966492:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966499:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832978.966515:0:16306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787832978.966606:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b7192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5446e631-f40d-43fa-8297-9fb53157ce22+19:14547:x1874678283107200:12345-192.168.201.34@tcp:35:lhsmtool_posix.0 Request processed in 1135us (1301us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1787832978.966615:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 13 00000020:00080000:1.0:1787832978.966621:0:16306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787832978.966761:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787832978.966769:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.966776:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c357ad41600 already unused, calling callback (ffffffffc160a420) 00010000:00010000:0.0:1787832978.966781:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.966799:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.966813:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c3543a9cd00) 00010000:00010000:0.0:1787832978.966816:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787832978.966822:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.966829:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41600/0x72bd9178b14b8338 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.966841:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832978.966848:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832978.966850:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787832978.971969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:0.0:1787832978.972220:0:16068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283107328 00000100:00100000:0.0:1787832978.972232:0:16068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283107328 00000100:00100000:0.0:1787832978.972293:0:16068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832978.972302:0:16068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+7:14545:x1874678283107328:12345-192.168.201.34@tcp:101:bash.0 00010000:00010000:0.0:1787832978.972321:0:16068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787832978.972343:0:16068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c3ea1f/0x72bd9178b14b833f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706c9f expref: -99 pid: 16068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787832978.972368:0:16068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a902a92, atime: 0x6a902a90, ctime: 0x6a902a92, blocks: 0x1 00010000:00010000:0.0:1787832978.972391:0:16068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787832978.972395:0:16068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787832978.972406:0:16068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c3ea1f/0x72bd9178b14b833f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c9f expref: 8 pid: 16068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.972423:0:16068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028c3ea1f/0x72bd9178b14b833f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706c9f expref: 8 pid: 16068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787832978.972438:0:16068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3443a00e00, rc 0) 00000100:00100000:0.0:1787832978.972500:0:16068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b589a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5446e631-f40d-43fa-8297-9fb53157ce22+8:14545:x1874678283107328:12345-192.168.201.34@tcp:101:bash.0 Request processed in 199us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787832978.972507:0:16068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:0.0:1787832978.980388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832978.980467:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283107584 00000100:00100000:3.0:1787832978.980478:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283107584 00000100:00100000:3.0:1787832978.980535:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 14 00000100:00100000:3.0:1787832978.980545:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+19:14545:x1874678283107584:12345-192.168.201.34@tcp:35:bash.0 00000001:00080000:3.0:1787832978.980878:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787832978.981258:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787832978.981372:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5446e631-f40d-43fa-8297-9fb53157ce22+22:14545:x1874678283107584:12345-192.168.201.34@tcp:35:bash.0 Request processed in 827us (992us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787832978.981381:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 14 00000020:00080000:3.0:1787832978.981386:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787832979.156228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:1.0:1787832979.156478:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283107840 00000100:00100000:1.0:1787832979.156489:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283107840 00000100:00100000:1.0:1787832979.156561:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00100000:1.0:1787832979.156572:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+22:14557:x1874678283107840:12345-192.168.201.34@tcp:101:lfs.0 00010000:00010000:1.0:1787832979.156598:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787832979.156621:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc5909db00b706ca6 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787832979.156940:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787832979.157290:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8346 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ca6 expref: 24 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832979.157306:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3559189c00) 00010000:00010000:1.0:1787832979.157310:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787832979.157315:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c357ad41000/0x72bd9178b14b8346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.34@tcp remote: 0xc5909db00b706ca6 expref: 24 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787832979.157328:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c357ad41000, rc 0) 00000100:00100000:1.0:1787832979.157401:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5446e631-f40d-43fa-8297-9fb53157ce22+23:14557:x1874678283107840:12345-192.168.201.34@tcp:101:lfs.0 Request processed in 832us (1183us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1787832979.157409:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 61 00000100:00080000:0.0:1787832979.158320:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787832979.171626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832979.172014:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283107968 00000100:00100000:3.0:1787832979.172033:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283107968 00000100:00100000:3.0:1787832979.172109:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:3.0:1787832979.172120:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+23:14557:x1874678283107968:12345-192.168.201.34@tcp:34:lfs.0 00010000:00010000:3.0:1787832979.172217:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172238:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172252:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172267:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172274:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172281:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172582:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172592:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172598:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787832979.172642:0:14434:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172655:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172668:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172675:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172681:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832979.172686:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172695:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172752:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3559189f00) 00010000:00010000:3.0:1787832979.172756:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832979.172762:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172769:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030a00/0x72bd9178b14b8354 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172794:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172801:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172808:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172812:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540030400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832979.172822:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172829:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172837:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c3543a9cc00) 00010000:00010000:3.0:1787832979.172840:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832979.172843:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172849:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540030400/0x72bd9178b14b835b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172864:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172870:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172875:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172880:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3540031600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787832979.172883:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172889:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172895:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3543a9c600) 00010000:00010000:3.0:1787832979.172897:0:14434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787832979.172906:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787832979.172912:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3540031600/0x72bd9178b14b8362 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787832979.173004:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b58b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5446e631-f40d-43fa-8297-9fb53157ce22+23:14557:x1874678283107968:12345-192.168.201.34@tcp:34:lfs.0 Request processed in 884us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832979.173013:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 62 00000100:00100000:0.0:1787832979.181121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832979.182562:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108224 00000100:00100000:3.0:1787832979.182746:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108224 00000100:00100000:3.0:1787832979.182900:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 15 00000100:00100000:3.0:1787832979.182913:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+23:14557:x1874678283108224:12345-192.168.201.34@tcp:35:lfs.0 00000100:00100000:3.0:1787832979.183759:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c354b71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5446e631-f40d-43fa-8297-9fb53157ce22+24:14557:x1874678283108224:12345-192.168.201.34@tcp:35:lfs.0 Request processed in 845us (2644us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1787832979.183770:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 15 00010000:00010000:1.0:1787832979.211870:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787832980.237845:0:15750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787832980.510781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.510826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.510853:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108608 00000100:00100000:2.0:1787832980.510872:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108608 00000100:00100000:2.0:1787832980.510931:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787832980.510941:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2352:x1874678283108608:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511011:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2352:x1874678283108608:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511019:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 18 00000100:00100000:2.0:1787832980.511056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.511155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.511170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.511187:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108864 00000100:00100000:2.0:1787832980.511190:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108864 00000100:00100000:2.0:1787832980.511216:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108480 00000100:00100000:2.0:1787832980.511219:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108480 00000100:00100000:2.0:1787832980.511234:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787832980.511240:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283108864:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511275:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ff6567d-af40-4908-85d0-cd5fc99f89cd+6:2352:x1874678283108864:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511280:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 29 00000100:00100000:2.0:1787832980.511292:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832980.511298:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+24:2352:x1874678283108480:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511330:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5446e631-f40d-43fa-8297-9fb53157ce22+24:2352:x1874678283108480:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511348:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 30 00000100:00100000:2.0:1787832980.511381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.511411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:2.0:1787832980.511423:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283109120 00000100:00100000:2.0:1787832980.511438:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283109120 00000100:00100000:2.0:1787832980.511453:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108736 00000100:00100000:2.0:1787832980.511456:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108736 00000100:00100000:2.0:1787832980.511465:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108992 00000100:00100000:2.0:1787832980.511467:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108992 00000100:00100000:2.0:1787832980.511478:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1787832980.511483:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283109120:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511504:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283109120:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 21us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511510:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 19 00000100:00100000:2.0:1787832980.511520:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787832980.511525:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283108736:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511541:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+5:2352:x1874678283108736:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 16us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511547:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:2.0:1787832980.511555:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:2.0:1787832980.511560:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c357b2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283108992:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:2.0:1787832980.511576:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c357b2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ff6567d-af40-4908-85d0-cd5fc99f89cd+5:2352:x1874678283108992:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 16us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787832980.511590:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 21 00000100:00100000:1.0:1787832980.511749:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283108352 00000100:00100000:1.0:1787832980.511754:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283108352 00000100:00100000:1.0:1787832980.511797:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00100000:1.0:1787832980.511804:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c356039f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283108352:12345-192.168.201.34@tcp:400:kworker.0 00000100:00100000:1.0:1787832980.511835:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c356039f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c657dfb7-0284-47b4-ac0a-5336a0328df6+13:2352:x1874678283108352:12345-192.168.201.34@tcp:400:kworker.0 Request processed in 32us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832980.511841:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 123 00000100:00080000:0.0:1787832980.512266:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787832980.512271:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787832980.512273:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832980.748287:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787832980.748309:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b58a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300911744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787832980.748377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787832980.748555:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300911744 00000100:00100000:1.0:1787832980.748564:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300911744 00000100:00100000:1.0:1787832980.748631:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787832980.748641:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543273840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300911744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787832980.748688:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787832980.748772:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543273840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300911744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832980.748781:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787832980.748836:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787832980.748930:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b58a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300911744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787832981.261037:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787832981.432492:0:16696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1787832981.500734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832981.500791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.34@tcp (source: 12345-192.168.201.34@tcp) 00000100:00100000:3.0:1787832981.500834:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283109376 00000100:00100000:3.0:1787832981.500845:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283109376 00000100:00100000:3.0:1787832981.500900:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:3.0:1787832981.500909:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2355:x1874678283109376:12345-192.168.201.34@tcp:16:kworker.0 00000100:00100000:3.0:1787832981.501040:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2355:x1874678283109376:12345-192.168.201.34@tcp:16:kworker.0 Request processed in 132us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832981.501058:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 20 00000100:00100000:0.0:1787832981.501440:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678283109248 00000100:00100000:0.0:1787832981.501446:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678283109248 00002000:00100000:0.0:1787832981.501471:0:15122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8c3543272940 x1874678283109248/t0(0) o4->5446e631-f40d-43fa-8297-9fb53157ce22@192.168.201.34@tcp:542/0 lens 504/0 e 0 to 0 dl 1787832992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787832981.501482:0:15122:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3543272940 with x1874678283109248 ext(0->8) 00002000:00010000:0.0:1787832981.501488:0:15122:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3543272940 00000100:00100000:0.0:1787832981.501508:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.34@tcp, seq: 0 00000100:00100000:0.0:1787832981.501515:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543272940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5446e631-f40d-43fa-8297-9fb53157ce22+8:2355:x1874678283109248:12345-192.168.201.34@tcp:4:bash.0 00000100:00100000:0.0:1787832981.501921:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543272940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5446e631-f40d-43fa-8297-9fb53157ce22+10:2355:x1874678283109248:12345-192.168.201.34@tcp:4:bash.0 Request processed in 406us (1222us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787832981.501929:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.34@tcp, seq: 0 00002000:00100000:0.0:1787832981.501936:0:15122:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8c3543272940 x1874678283109248/t8589934598(0) o4->5446e631-f40d-43fa-8297-9fb53157ce22@192.168.201.34@tcp:542/0 lens 504/448 e 0 to 0 dl 1787832992 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787832981.501957:0:15122:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3543272940 with x1874678283109248 ext(0->8) 00002000:00010000:0.0:1787832981.501960:0:15122:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c3543272940 00010000:00010000:1.0:1787832982.283869:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787832982.796948:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3543270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300911872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787832982.797026:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787832982.797078:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300912256:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.797091:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300912384:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.797113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.797493:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787832982.797500:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300912000:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.797531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.797554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300912512:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.797575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.797606:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300911872 00000100:00100000:3.0:1787832982.797614:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300911872 00000100:00100000:1.0:1787832982.797779:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912384 00000100:00100000:1.0:1787832982.797784:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912384 00000100:00100000:1.0:1787832982.797823:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912512 00000100:00100000:1.0:1787832982.797826:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912512 00000100:00100000:3.0:1787832982.797891:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787832982.797902:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543271680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300911872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787832982.797937:0:15120:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787832982.797986:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543271680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874678300911872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832982.797994:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787832982.798018:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300912128:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798049:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912000 00000100:00100000:3.0:1787832982.798052:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912000 00000100:00100000:3.0:1787832982.798080:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787832982.798086:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3542d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300912000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798117:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3542d3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea647735-d55a-4124-bae8-f7db9715e04e+19:3307:x1874678300912000:12345-0@lo:400:kworker.0 Request processed in 31us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832982.798133:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787832982.798162:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787832982.798169:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300912384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798199:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874678300912384:12345-0@lo:400:kworker.0 Request processed in 31us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832982.798205:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787832982.798393:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787832982.798401:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300912512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832982.798436:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874678300912512:12345-0@lo:400:kworker.0 Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832982.798442:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787832982.798485:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787832982.798490:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787832982.798528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ea647735-d55a-4124-bae8-f7db9715e04e:3307:1874678300912000:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798542:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b719a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874678300912512:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798551:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b719e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874678300912384:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.798565:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3543270f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874678300911872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787832982.799621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.801335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.801394:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300912640:0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.801450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787832982.801499:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912640 00000100:00100000:3.0:1787832982.801508:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912640 00000100:00100000:3.0:1787832982.801571:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787832982.801581:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c35432721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787832982.801639:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c35432721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874678300912640:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787832982.801646:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787832982.801670:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787832982.801699:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874678300912640:0@lo:400:kworker.0 00000100:00100000:1.0:1787832982.804007:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912256 00000100:00100000:1.0:1787832982.804023:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912256 00000100:00100000:1.0:1787832982.804081:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874678300912128 00000100:00100000:1.0:1787832982.804084:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874678300912128 00000100:00100000:1.0:1787832982.804127:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832982.804137:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3441ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300912256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832982.804257:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3441ef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874678300912256:12345-0@lo:400:kworker.0 Request processed in 122us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832982.804265:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787832982.804282:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787832982.804289:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3543270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300912128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787832982.804324:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3543270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874678300912128:12345-0@lo:400:kworker.0 Request processed in 36us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787832982.804340:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787832982.804363:0:14430:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787832982.804405:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b718f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874678300912128:0@lo:400:kworker.0 00000100:00100000:0.0:1787832982.808682:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c354b71a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874678300912256:0@lo:400:kworker.0 Debug log: 29784 lines, 29784 kept, 0 dropped, 0 bad.